-- Logs begin at Tue 2022-05-03 08:12:24 UTC, end at Tue 2022-05-03 09:44:10 UTC. -- May 03 08:38:47.709747 dv-cinder-840276-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 08:38:47.718013 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 08:38:47.720734 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 08:38:47 2022] *** May 03 08:38:47.720906 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 08:38:47.721056 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 08:38:47.721191 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: nodename: dv-cinder-840276-2-iscsi May 03 08:38:47.721321 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: machine: x86_64 May 03 08:38:47.721447 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: clock source: unix May 03 08:38:47.721574 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: pcre jit disabled May 03 08:38:47.721702 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: detected number of CPU cores: 4 May 03 08:38:47.721823 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: current working directory: / May 03 08:38:47.721956 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: detected binary path: /usr/bin/uwsgi-core May 03 08:38:47.722089 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: your processes number limit is 47680 May 03 08:38:47.722220 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: your memory page size is 4096 bytes May 03 08:38:47.722350 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: detected max file descriptor number: 2048 May 03 08:38:47.722487 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: lock engine: pthread robust mutexes May 03 08:38:47.722790 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: thunder lock: enabled May 03 08:38:47.723102 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 08:38:47.723309 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 08:38:47.767476 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: Python main interpreter initialized at 0x55c5ed53b9c0 May 03 08:38:47.767476 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: python threads support enabled May 03 08:38:47.767476 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: your server socket listen backlog is limited to 100 connections May 03 08:38:47.767476 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: your mercy for graceful operations on workers is 90 seconds May 03 08:38:47.767959 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: mapped 403077 bytes (393 KB) for 2 cores May 03 08:38:47.767959 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: *** Operational MODE: preforking *** May 03 08:38:47.768196 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: *** uWSGI is running in multiple interpreter mode *** May 03 08:38:47.768196 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: spawned uWSGI master process (pid: 86202) May 03 08:38:47.768443 dv-cinder-840276-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 08:38:47.771796 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: spawned uWSGI worker 1 (pid: 86213, cores: 1) May 03 08:38:47.771796 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: spawned uWSGI worker 2 (pid: 86214, cores: 1) May 03 08:38:47.771796 dv-cinder-840276-2-iscsi devstack@keystone.service[86202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 08:38:53.428520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:38:53.428520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: from cryptography.utils import int_from_bytes May 03 08:38:53.429374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:38:53.429374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: from cryptography.utils import int_from_bytes May 03 08:38:53.429788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:38:53.429788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: from cryptography.utils import int_from_bytes May 03 08:38:53.429895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:38:53.429895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: from cryptography.utils import int_from_bytes May 03 08:38:53.478111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:38:53.478281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:38:53.478356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:38:53.478431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:38:53.478496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] command line args: [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:38:53.478562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] command line args: [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:38:53.478626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:38:53.478889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:38:53.478972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ================================================================================ {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:38:53.479038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ================================================================================ {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:38:53.479101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] admin_token = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] admin_token = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] config_dir = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] config_dir = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] config_source = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] config_source = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] debug = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.479954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] debug = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.480016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.482968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_config_append = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_config_append = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_dir = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_dir = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_file = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_file = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.483917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.484967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.485407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.486123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.486300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.486521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] publish_errors = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.486686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] publish_errors = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.486877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.487098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.487263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.487446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.487627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.487864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.488028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.488342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.488539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.488697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.488896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] standard_threads = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.489078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] standard_threads = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.489268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.489458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.489639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.489825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.490006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.490188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.490379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] use_journal = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.490569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] use_journal = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.490821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] use_json = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] use_json = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] use_stderr = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] use_stderr = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] use_syslog = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] use_syslog = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.491918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.492046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:38:53.492179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.492641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.492806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.492931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.493939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.494906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.495992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.496999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.497882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.498922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.499969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.500921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.501924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.502881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.503957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.504082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.504214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.504339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.505570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.505759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.505942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.506126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.506309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.506511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.506729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.506889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.507070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.507253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.507436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.507737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.508031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.508206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.508570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.508872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.509183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.509480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.509897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.510154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.510387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.510633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.510837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.511149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.511408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.511644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.511860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.512906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.513853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.514884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.515964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.516927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.517876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.518900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.519949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.520981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.521881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522347 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.522999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.523902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.external = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.external = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.524958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.password = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] auth.token = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.password = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.525864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] auth.token = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.526898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.527938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.528980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.529865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.530982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.531906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.532997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.533934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.534959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.535884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.536903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.537960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.538979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.539942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.540965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.541975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.542868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.543912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.544951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.545965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.546874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.547967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.548983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.549882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.550907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.551953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.552973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.553985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.554891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.555943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.556969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.557985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.558894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.559980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] role.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.560758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] role.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] role.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.561773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] role.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.562927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.563981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.564107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.564232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.564365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.564555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.564912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.565042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.565175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.565752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.565752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.566202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.566351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.566594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.566594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.567019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.567347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.567549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.567719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.568180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.568340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.568468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.568706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.569054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.569221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.569350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.569751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.569893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570763 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.570889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.571949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.572983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.573949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.574119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.574273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.574408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.574541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.574673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.575130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.575702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.576351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.576503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.576638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.576770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.576903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.577900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.578978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.connection = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.connection = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.579978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.580927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.581743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.582588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.582760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.582895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.583029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.583547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.583706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.584776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:38:53.586254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.586254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.586254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.586254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:38:53.586254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:38:53.593713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.593713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.593713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.603625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.616879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.617181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.617783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.626547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.632314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.632548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.645357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.645654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.685668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.688616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.736840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.737017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.737310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.737602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.806757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.807846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.808062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.808211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.808298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.808375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.831441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.831600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.831706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.831909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.831996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.832953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.833229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.833504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.844061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.844718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.858862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.859977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.860104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.860104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.860338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.860547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.860815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.861086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:38:53.877566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.877845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:38:53.878027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.878179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:38:53.878325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.878456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.878580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:38:53.878703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:38:53.878827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.879844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.880182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.890587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.890857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.891124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.891402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.891599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.891757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.892091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.892460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.899529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.900609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.903131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.903400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.903678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.904072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.904394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.904757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.904852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.904931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.905934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.906123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.906206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.906391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.906655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.906921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.907179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.932614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.933662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.934209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.934483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.935267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.935539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.939731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.940031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.940308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.940819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.941088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.941370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.947662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.947976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.948726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.948999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.952575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.952852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.953130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.953405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.953574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.953693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.953876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.954656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.955014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.955157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.955435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.973086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.973351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.974036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.974308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.977928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.978885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.981556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.981843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.982472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.982756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.986789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.987726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.990373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.991236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:53.994439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.994730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.995957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.996111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.996376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:53.996644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.014792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.015099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.015366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.015534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.015660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.015946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.016209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.016464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.023492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.024325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.025211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.025493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.026022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.026286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.028562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.028839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.029120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.029339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.029467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.029589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.029695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.029896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.030170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.030443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.043080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.043352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.043625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.043926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.044182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.044800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.045005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.045250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.045540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.063597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.066838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.067383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.070325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.070739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.072009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.073616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.073885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.074158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.074284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.075799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.077438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.077707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.077995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.081775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.083373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.085847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.086634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.086920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.087200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.087456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.087582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.090679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.090967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.091251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.091635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.096612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.096900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.097181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.100802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.101096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.101374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.105177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.105482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.105817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.106121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.106383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.106653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.106920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.107193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.107450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.107708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.107998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.108235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.108499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.108837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.109356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:38:54.109633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.109924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.110185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.110453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.110732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.110984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.111262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.111525 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.111806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.112080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.112335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.112603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.112873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:38:54.148140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5ed53b9c0 pid: 86213 (default app) May 03 08:38:54.151812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e386d-1d93-4afa-86dc-1fe4bb41ee48 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:38:54.152080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e386d-1d93-4afa-86dc-1fe4bb41ee48 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:38:54.152275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5ed53b9c0 pid: 86214 (default app) May 03 08:38:54.152414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e386d-1d93-4afa-86dc-1fe4bb41ee48 None None] PATH_INFO: `/v3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:38:54.156665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 791 bytes} [Tue May 3 08:38:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:02.176272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:02.176894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:02.176894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:02.181118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1/2] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:02.186578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:02.187024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:02.187111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:02.218006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG oslo_db.sqlalchemy.engines [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:39:02.404297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG passlib.handlers.bcrypt [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86213) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 08:39:02.404706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG passlib.handlers.bcrypt [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86213) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 08:39:02.459237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:02.460872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:02.587200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 2/3] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 08:39:02.765911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:02.800464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:39:02.925835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4684fd-f005-4351-92d6-a97c380980c8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:02.930556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:02.931204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:02.931484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:02.931758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:02.939937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:02.991427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING keystone.common.rbac_enforcer.enforcer [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 08:39:02.991733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70388-6956-4456-9e6a-b6f737270ba6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:03.001673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 2/4] 10.222.0.11 () {58 vars in 1324 bytes} [Tue May 3 08:39:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:39:03.007879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:03.022356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dbb78-e62d-4f8c-9156-02a4910b3020 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:03.028197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:03.029490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:03.029863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:03.030219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] PATH_INFO: `/v3/projects/a709989f94ec462eae85b1893e89377a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:03.031952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a709989f94ec462eae85b1893e89377a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:03.081781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 08:39:03.082119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daba4ee-a35c-4331-a5e0-382a2d850bd9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:03.086718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 3/5] 10.222.0.11 () {56 vars in 1207 bytes} [Tue May 3 08:39:03 2022] GET /identity/v3/projects/a709989f94ec462eae85b1893e89377a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:05.284588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d365-fb0d-4a3f-98b4-620108d6d2fb None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:05.285124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d365-fb0d-4a3f-98b4-620108d6d2fb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:05.285124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d365-fb0d-4a3f-98b4-620108d6d2fb None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:05.289348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 3/6] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:05.294998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:05.295410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:05.295638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:05.315952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:05.317447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:05.325942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 4/7] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 08:39:05.348114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d365-fb0d-4a3f-98b4-620108d6d2fb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:05.362069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d365-fb0d-4a3f-98b4-620108d6d2fb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:05.367259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:05.368262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:05.368547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:05.368876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:05.376845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:05.378657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e4314-6f30-43d7-8278-6f0928b4f98c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:05.387566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 4/8] 10.222.0.11 () {58 vars in 1324 bytes} [Tue May 3 08:39:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:39:05.393256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:05.402657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c418bee-b4f0-462d-833c-2427576a242d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:05.408069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:05.408945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:05.409226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:05.409501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:05.410986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:05.412922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bea86-44da-43c6-b550-f0cbf4df821c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:05.414482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 5/9] 10.222.0.11 () {56 vars in 1198 bytes} [Tue May 3 08:39:05 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:07.679146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30dc0f-f507-4f29-944e-c376c048f8d0 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:07.679700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30dc0f-f507-4f29-944e-c376c048f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:07.679700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30dc0f-f507-4f29-944e-c376c048f8d0 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:07.681276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 5/10] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:07.687213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:07.687742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:07.687742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:07.776233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4220-4abd-42ff-b002-6934490974c6 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:07.776574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4220-4abd-42ff-b002-6934490974c6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:07.776810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4220-4abd-42ff-b002-6934490974c6 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:07.778216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 6/11] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:07.784523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:07.784879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:07.785090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:07.815916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:07.817098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:07.825246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG passlib.handlers.bcrypt [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86214) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 08:39:07.825657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG passlib.handlers.bcrypt [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86214) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 08:39:07.871948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:07.873544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:07.898527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 6/12] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:07.920918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:07.974344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 7/13] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:07.996240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.016473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fa8fa-b576-4545-a82f-78b1ddb0eb99 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.048676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.049480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.049756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.050031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.060791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:08.072118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:08.073160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:08.073995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 7/14] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:08.079654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.096457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b649d9-127c-4bcd-a162-a3f6345a510c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.130518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.131526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.131838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.132119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.175912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07e1d-0dc8-46a7-9c17-f1501f81b515 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.197503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.199024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.211067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.211951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.212237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.212508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.213266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:08.213567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.214957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.227014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 8/15] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:08.232342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.292086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 8/16] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:39:08.297369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.326091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e75ef-72fb-440c-b8b1-94830c85a5f6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.358962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.359878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.360152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.360403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.361602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.363060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.364933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 9/17] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:08.370968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.395659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683169b-8c8a-4ba5-8a51-36512d1891cd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.427390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.428262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.428540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.428805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.467428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a94c-28df-44fc-ab89-56e5db94a46b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.503874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.504619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.504898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.505170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.506467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.507956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.509820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 10/18] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:08.515503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.556317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.557766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:39:08.577984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:08.578858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:08.579692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:39:08.579692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:39:08.579692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:39:08.579692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:08.584044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 9/19] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:08.585044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:08.625704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3192-b239-475e-8d11-993bd18a2989 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.659733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.660410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.660680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.660968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.661796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.domain.id=default, user.id=155689b863d044f782598840d769a7ed) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:08.662085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.663589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582c939-8f71-4d5f-afef-8c30e3ba1907 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.670496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 11/20] 10.222.0.11 () {56 vars in 1322 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/role_assignments?user.id=155689b863d044f782598840d769a7ed&scope.domain.id=default&role.id=40264f46cb744114a960ef46085a53c3 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:08.682607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9334d-4499-429e-b95f-e8281473755f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:08.718503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:08.719172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:08.719449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:08.719717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:08.720469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:08.720771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:08.722159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f617-8295-4693-8f0b-cc1a530a1be9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:08.742026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 10/21] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:11.376964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10c54-7fef-4ffd-8442-255993fae1fd None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.377990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10c54-7fef-4ffd-8442-255993fae1fd None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.378472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10c54-7fef-4ffd-8442-255993fae1fd None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.380363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 12/22] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:11.385903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.386713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.387177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.405044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:11.406578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:11.483981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 11/23] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:11.498670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709259da-a306-4eca-b6b3-85ba2ea1d540 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.499212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709259da-a306-4eca-b6b3-85ba2ea1d540 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.499674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709259da-a306-4eca-b6b3-85ba2ea1d540 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.501269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 13/24] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:11.507342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:11.511502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f76f2-8a7a-4091-a83a-16a7fb2bff2d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.511809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f76f2-8a7a-4091-a83a-16a7fb2bff2d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.512093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f76f2-8a7a-4091-a83a-16a7fb2bff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.552820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-2f5f76f2-8a7a-4091-a83a-16a7fb2bff2d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:11.554163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2f5f76f2-8a7a-4091-a83a-16a7fb2bff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:11.609061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6929e22-2bcc-45b0-a567-46a9784c8f8f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:11.648001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 14/25] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:11.649348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd453-f257-4b6a-b6bc-008a3ca23b6e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.649640 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd453-f257-4b6a-b6bc-008a3ca23b6e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.649904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd453-f257-4b6a-b6bc-008a3ca23b6e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.651178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:11.651477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 15/26] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:11.652428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.652909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.653381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.656965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.657258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.657541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.666518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:11.676624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:11.677496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:11.678348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:11.681201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 12/27] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:11.688730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:11.688933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:11.690113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:11.756312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 16/28] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:11.757093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:11.857964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cae90-8be6-4d0a-a34c-e8ba86236f82 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:11.897209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:11.897958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:11.898244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:11.898703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:11.899473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:11.899795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:11.901214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:11.910861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 17/29] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:11.916341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:11.922002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf807-d80a-422c-a05f-956fba24feda None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.008361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.009089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.009377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.009657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.021271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10354f2-d564-4a21-abbd-f5f92e9b2a67 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.032828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.034329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.055831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.056510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.057099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.057374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.058122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.059497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:39:12.070710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:12.071882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:12.072861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:39:12.072861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:39:12.072861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:39:12.072861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:12.073412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 13/30] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:12.074253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:12.198611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 18/31] 10.222.0.11 () {60 vars in 1131 bytes} [Tue May 3 08:39:11 2022] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:12.200268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:12.317342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0212e7-1c21-4460-b942-3f552dd9f248 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.355807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.356736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.357322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.357760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.358652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:12.359093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.361304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.366097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ce526-fb77-47ba-97eb-851479304802 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.382644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 19/32] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:12.389136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:12.440034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.440034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.440034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.440034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.440837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.441344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.451794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 14/33] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:12 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:12.460977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:12.519406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca735-818b-4497-ab19-6c02a702a1e9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.555300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.556253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.556675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.557084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.557957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.559560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.598895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 20/34] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:39:12 2022] POST /identity/v3/projects => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:12.622233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebc77-6259-40bc-be6f-e71044445e2e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.659834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.660967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.661388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.661850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.663411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.665221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817335f-4b77-4d8f-8996-b4c6d043925a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.667285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 15/35] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:12.673336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:12.792541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea2ad-21e8-47c8-8cb9-6485afcb8ad2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:12.839191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:12.840456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:12.840896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:12.841315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] PATH_INFO: `/v3/domains/default/users/155689b863d044f782598840d769a7ed/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:12.844022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=155689b863d044f782598840d769a7ed, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:12.845743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6e231-9be5-4ab6-a3a1-da5db095a368 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:12.868006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 21/36] 10.222.0.11 () {58 vars in 1361 bytes} [Tue May 3 08:39:12 2022] PUT /identity/v3/domains/default/users/155689b863d044f782598840d769a7ed/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:13.027318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705084-4334-4c3f-9452-8d8bb578cc0d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.027864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705084-4334-4c3f-9452-8d8bb578cc0d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.028275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705084-4334-4c3f-9452-8d8bb578cc0d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.029853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 16/37] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:13.036020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b84d1-a3db-4781-bdfb-5d4614f21069 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.036554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b84d1-a3db-4781-bdfb-5d4614f21069 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.036970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b84d1-a3db-4781-bdfb-5d4614f21069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.055439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b33b84d1-a3db-4781-bdfb-5d4614f21069 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:13.057313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b33b84d1-a3db-4781-bdfb-5d4614f21069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:13.130174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 22/38] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:13.156350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705084-4334-4c3f-9452-8d8bb578cc0d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:13.257014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705084-4334-4c3f-9452-8d8bb578cc0d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:13.291350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:13.292074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.292352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.292623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.293396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:13.294832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87925d1-20f6-4b8e-89e8-8a57a31355f9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:13.422165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 17/39] 10.222.0.11 () {60 vars in 1131 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:13.482534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b401-c362-4e93-bb85-6e4f9ca0848c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.483055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b401-c362-4e93-bb85-6e4f9ca0848c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.483403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b401-c362-4e93-bb85-6e4f9ca0848c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.485255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 23/40] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:13.491103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.491652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.491652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.509637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418f9b-ac6f-420b-91dd-b43cb78a6307 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.510076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418f9b-ac6f-420b-91dd-b43cb78a6307 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.510203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:13.510525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418f9b-ac6f-420b-91dd-b43cb78a6307 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.511755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:13.512177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 24/41] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:13.519139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.519430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.519702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.537577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:13.538813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:13.588263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 18/42] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:13.611897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:13.612448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 25/43] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:13.636518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:13.714464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8589c98-08c6-43f3-98d6-c5cae1c98798 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:13.749480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48b9ad-0225-4e98-807b-bb62b12767b4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:13.750507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:13.751196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.751485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.751760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.752551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:13.754093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:13.768278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 19/44] 10.222.0.11 () {60 vars in 1131 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:39:13.789911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:13.790747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.791025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.791296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.792611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:13.794115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b868658-0e6f-47a0-8f62-3cd1638bbf76 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:13.796044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 26/45] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:13.802136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:13.916484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d68a1-706e-4011-abed-188885b37813 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:13.951077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:13.951751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:13.952072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:13.952350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:13.953080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:13.954566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471aa82-fed2-453d-ac75-c02245a98fd2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:13.984640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 20/46] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:39:13 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:15.223938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57798-1755-46f4-ac0c-dfcc497c3c94 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.224700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57798-1755-46f4-ac0c-dfcc497c3c94 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.224985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57798-1755-46f4-ac0c-dfcc497c3c94 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.226415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 27/47] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:15.231703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.232148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.232416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.249641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:15.251103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:15.318927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 21/48] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:15.341860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57798-1755-46f4-ac0c-dfcc497c3c94 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:15.448334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57798-1755-46f4-ac0c-dfcc497c3c94 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:15.482923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:15.483648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.483977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.484251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.495622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:15.503162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:15.504332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:15.505122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 28/49] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:15.510641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:15.607584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a6dcb-2b53-4674-a2af-ecbc45a574bd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:15.642494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:15.643163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.643445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.643725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.644503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:15.644810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:15.646205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:15.657565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 22/50] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:15.663433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:15.759451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c38d-a345-4569-a83d-a57736375a86 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:15.792292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:15.793165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.793451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.793726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.794929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:15.796416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:15.798031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 29/51] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:15 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:15.803648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:15.900609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15572fc-f7bc-4ade-95f1-104e9392c876 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:15.934878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:15.935665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:15.936140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:15.936609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:15.938088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:15.939530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27eb09-13bd-4bd4-8f4b-a28a5c8adc36 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:15.941182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 23/52] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:15.947158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:16.047713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bdb5-aec4-49ba-aba6-9d309c6fb486 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:16.083819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:16.084574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:16.084850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:16.085127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:16.085966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.domain.id=default, user.id=155689b863d044f782598840d769a7ed) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:16.086268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:16.087710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2c9c-e76c-4891-8200-c2834204c6b7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:16.093712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 30/53] 10.222.0.11 () {56 vars in 1322 bytes} [Tue May 3 08:39:15 2022] GET /identity/v3/role_assignments?user.id=155689b863d044f782598840d769a7ed&scope.domain.id=default&role.id=40264f46cb744114a960ef46085a53c3 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:16.234709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091f2c-a666-4df9-b516-f78200104898 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:16.235251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091f2c-a666-4df9-b516-f78200104898 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:16.235251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091f2c-a666-4df9-b516-f78200104898 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:16.236874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 24/54] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:16.243236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:16.243746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:16.243746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:16.261452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:16.262668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:16.329364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 31/55] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:16.358197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091f2c-a666-4df9-b516-f78200104898 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:16.465189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091f2c-a666-4df9-b516-f78200104898 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:16.501017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:16.501799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:16.502085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:16.502358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:16.503643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:16.505151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3709e-c16d-4480-8a0a-020236e8bb98 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:16.506818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 25/56] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:16.515417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:16.619719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2bdf-d8df-45f0-a107-ec0bb88270e9 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:16.656049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:16.656700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:16.656983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:16.657258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:16.657961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:16.659425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf2a42-206f-4bf6-a386-c8068b9f74bf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:16.690761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 32/57] 10.222.0.11 () {60 vars in 1140 bytes} [Tue May 3 08:39:16 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:18.909316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05917b5-6c09-4625-b124-f7020a07720d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:18.909868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05917b5-6c09-4625-b124-f7020a07720d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:18.909868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05917b5-6c09-4625-b124-f7020a07720d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:18.911253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 26/58] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:18.917560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:18.918245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:18.918452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:18.940756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:18.941950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:19.020619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 33/59] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:19.045874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05917b5-6c09-4625-b124-f7020a07720d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:19.159119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05917b5-6c09-4625-b124-f7020a07720d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:19.192779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:19.193518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:19.193801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:19.194077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:19.195395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:19.196879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94e9a5-a1cd-4985-8982-e7ce366a74ff None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:19.198483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 27/60] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:19.204205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:19.302845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea5635-073f-4ad8-a414-4603d35c15a2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:19.337643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:19.338306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:19.338591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:19.338865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:19.339569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:19.341058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e11d7-9aa1-4255-a713-c8815ae4982b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:19.369046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 34/61] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:19 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:22.734177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802534b3-cd9c-4f97-9a99-9a70c43555b6 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:22.735213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802534b3-cd9c-4f97-9a99-9a70c43555b6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:22.735719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802534b3-cd9c-4f97-9a99-9a70c43555b6 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:22.737508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 28/62] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:22.743150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796794db-b60a-4bc7-a621-dde3cf2030ba None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:22.744043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796794db-b60a-4bc7-a621-dde3cf2030ba None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:22.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796794db-b60a-4bc7-a621-dde3cf2030ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:22.768786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-796794db-b60a-4bc7-a621-dde3cf2030ba None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:22.770326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-796794db-b60a-4bc7-a621-dde3cf2030ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:22.854355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecbbb-5b69-4929-a2f9-fba5f9c2da8a None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:22.854869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 35/63] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:22.855158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecbbb-5b69-4929-a2f9-fba5f9c2da8a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:22.855447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecbbb-5b69-4929-a2f9-fba5f9c2da8a None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:22.857080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 29/64] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:22.861850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:22.862160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:22.862443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:22.883482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ecbbb-5b69-4929-a2f9-fba5f9c2da8a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:22.888769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:22.889954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:23.015929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 36/65] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:23.023810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ecbbb-5b69-4929-a2f9-fba5f9c2da8a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.051187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.059791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.060826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.061280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.062121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.078805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:23.089105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:23.089971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:23.090801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:23.100474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 30/66] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:23.106852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.204078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b409-d7b8-4985-b841-5994cc353ecf None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.240327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401141fa-26d7-426e-9612-9956abf4137a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.242925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.243828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.244117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.244389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.254156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e267bc2e-2da4-4acc-a0a8-0a67b79b854b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:23.261872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:23.262715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:23.263467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 37/67] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:23.264616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464daa-e1ca-4b24-add9-7b962c6b2d5d None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.264893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464daa-e1ca-4b24-add9-7b962c6b2d5d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.265154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464daa-e1ca-4b24-add9-7b962c6b2d5d None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 38/68] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869e66-4fdd-4196-b4b1-ce0c557b5a1c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869e66-4fdd-4196-b4b1-ce0c557b5a1c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869e66-4fdd-4196-b4b1-ce0c557b5a1c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 39/69] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:23.270566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869e66-4fdd-4196-b4b1-ce0c557b5a1c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.284251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.284941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.285280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.285556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.286317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:23.286628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.288063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23628a04-0d50-4bd2-8b7c-7dfb1a70492e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.297016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 31/70] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:23.298180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c53f5-1041-40aa-ae9f-dc8abf8f2a5f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.298473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c53f5-1041-40aa-ae9f-dc8abf8f2a5f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.298751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c53f5-1041-40aa-ae9f-dc8abf8f2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.314934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4a3c53f5-1041-40aa-ae9f-dc8abf8f2a5f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:23.316145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4a3c53f5-1041-40aa-ae9f-dc8abf8f2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:23.370916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869e66-4fdd-4196-b4b1-ce0c557b5a1c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.379876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 32/71] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:23.381141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.381427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.381711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.398914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:23.400147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:23.410070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.410742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.411026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.411341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.412156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:23.412468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.413865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6350de-7e31-4fa6-9810-fc41d8dc1e69 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.422746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 40/72] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:23.423810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a082be-5be9-4160-b047-e994a68851c4 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.424099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a082be-5be9-4160-b047-e994a68851c4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.424351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a082be-5be9-4160-b047-e994a68851c4 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.425579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 41/73] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:23.426407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a082be-5be9-4160-b047-e994a68851c4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.465619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 33/74] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:23.467620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.526540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a082be-5be9-4160-b047-e994a68851c4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.559880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.560759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.561038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.561273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2f0f0-a54e-4e56-9b75-266b42248185 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.561371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.574416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.575913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.577567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 42/75] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:23.578320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.592491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.593286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.593566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.593834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.604289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-bda78c2c-d2ca-4f3c-82ce-653538a7c43c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:23.611991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:23.613001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:23.613874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 34/76] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:23.614656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.614656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.614941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.631758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:23.632968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:23.675194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ebeb-4bab-428d-80c7-f52b06fecb90 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.696279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 35/77] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:23.707945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.713298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e902d-c775-48db-838c-946b67b67510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.714683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e902d-c775-48db-838c-946b67b67510 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.714967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e902d-c775-48db-838c-946b67b67510 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.715244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e902d-c775-48db-838c-946b67b67510 None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.716447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e902d-c775-48db-838c-946b67b67510 None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.718624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e902d-c775-48db-838c-946b67b67510 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.724771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 43/78] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:23.724771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e902d-c775-48db-838c-946b67b67510 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.795541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf1fb-24b0-4bbd-89c6-cf4b56f813fa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.822077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e902d-c775-48db-838c-946b67b67510 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.828727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.829534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.829815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.830085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.839934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:23.848091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:23.848949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:23.849799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 36/79] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:23.850425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:23.856688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.857341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.857629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.857909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.922797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.924276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.942866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb364c-c5a2-4d1e-8c75-e2e4e94bdd66 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:23.974380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:23.975041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:23.975328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:23.975609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:23.976388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:23.976697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:23.978084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:23.985870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 37/80] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:23.986490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.017375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 44/81] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:24.018219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.084260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a782b-c7c6-4a2d-8dd1-17ec3a2dd736 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.112028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec32e2-a717-4109-82d0-6f52f669c090 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.115370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.116185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.116462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.116733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.118208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.119647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.121354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 38/82] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.122110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.144568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.145212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.145498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.145799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.207830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.209413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.221122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7541-d59a-4147-b895-0e9a2d370011 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.252808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.253471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.253754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.254031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.254776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:24.255092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.256528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.264071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 39/83] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.264834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.305521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 45/84] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:24.312835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.377285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd902-5ea9-4a4d-b8f7-5443fb2ffe7c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.408039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2352-5e35-4e56-abe1-d741f859b363 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.408404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.409279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.409563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.409842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.411038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.412630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.414267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 40/85] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.415007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.440410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.441266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.441545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.441814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.442996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.444539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.446204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 46/86] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.446939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.507608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec093e-fa4b-4a31-bf78-95bf0070bb1f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.537904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28b52-e0ed-4871-842b-5a886b9c136a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.540141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.540884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.541163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.541434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.542110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.543546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.570098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.570968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.571245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.571518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.571671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 41/87] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:24 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:24.572512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.577142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.578632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.580631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 47/88] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.581194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.682307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a2fb-6b70-46bb-aa25-6b9e14595b0a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.686429 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b2e41-766b-4672-985e-3f9806b458f7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.716601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.717479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.717758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.718028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.719258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.720836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.727531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 42/89] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.727710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.727852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.727954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.727954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.727954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.799632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.800819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.836663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59fa28-6d21-487b-b4a3-2e63c22b6899 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:24.871896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:24.872559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:24.872842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:24.873120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:24.873969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:24.874270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:24.875736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:24.884536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 43/90] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=22c100d842ea400285feca8a56b61095 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:24.885453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.902396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 48/91] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:24.903176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:24.996015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcced5e-48db-4bfa-a4bb-9e2a79639405 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.027512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea574-a5d2-41f6-99b0-445ba75c8c7e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.031468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.032472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.032944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.033404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.069927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.070606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.070891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.071175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.079897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=155689b863d044f782598840d769a7ed) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:25.079897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.079897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.085904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 49/92] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/role_assignments?user.id=155689b863d044f782598840d769a7ed&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:25.086939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:25.178086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.180019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.225822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d9b01-70ce-4de2-9340-84ff8300b8ac None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.261750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.262551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.262833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.263108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] PATH_INFO: `/v3/projects/8d225288c9d041688e924d660be6c571` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.264363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] RBAC: Authorizing `identity:get_project(project_id=8d225288c9d041688e924d660be6c571)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.265838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.267568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 50/93] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:25 2022] GET /identity/v3/projects/8d225288c9d041688e924d660be6c571 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:25.273664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:25.385730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f70c-f38e-4439-a813-c846b1166555 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.421224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.422030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.422312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.422585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.423416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=8d225288c9d041688e924d660be6c571, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:25.423726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.425495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.431597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 51/94] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:25 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=8d225288c9d041688e924d660be6c571&role.id=22c100d842ea400285feca8a56b61095 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:25.442960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 44/95] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:25.448874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:25.561792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72cb1-35ae-43f9-8604-3346ca2ce889 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.596077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.596956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.597240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.597517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.598724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.600273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4120-ad3a-4092-83df-eb697b6a7943 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.602405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 52/96] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:25 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:25.608030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:25.760424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6fa9f-9e4f-443a-bd50-8ca671991f2c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:25.803468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:25.804193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:25.804483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:25.804763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:25.805614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:25.805931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:25.807412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a972bd-8870-4f82-b4c6-338a172b62ab None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:25.813656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 45/97] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:25 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=3cc7ef3638714f57a89fac869553e946 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:27.648546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e47-dbff-4033-bb4d-bea41c73aefb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:27.648546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e47-dbff-4033-bb4d-bea41c73aefb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:27.648546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e47-dbff-4033-bb4d-bea41c73aefb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:27.648546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 53/98] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:27.654479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a69-8b9c-45e6-b9ff-aad551d67e92 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:27.655428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a69-8b9c-45e6-b9ff-aad551d67e92 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:27.655921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a69-8b9c-45e6-b9ff-aad551d67e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:27.679556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e2191a69-8b9c-45e6-b9ff-aad551d67e92 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:27.681095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e2191a69-8b9c-45e6-b9ff-aad551d67e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:27.751093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 46/99] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:27.784899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec758e47-dbff-4033-bb4d-bea41c73aefb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:27.889415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec758e47-dbff-4033-bb4d-bea41c73aefb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:27.898497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1137b5-5def-437f-806f-3eea8890c751 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:27.899156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1137b5-5def-437f-806f-3eea8890c751 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:27.899638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1137b5-5def-437f-806f-3eea8890c751 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:27.901321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 47/100] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:27.912303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a225-6f1a-4180-b39b-4cc6c8dc2517 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:27.912827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a225-6f1a-4180-b39b-4cc6c8dc2517 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:27.913288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a225-6f1a-4180-b39b-4cc6c8dc2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:27.938399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:27.943805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:27.943805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:27.943805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:27.951019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-aa35a225-6f1a-4180-b39b-4cc6c8dc2517 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:27.952495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aa35a225-6f1a-4180-b39b-4cc6c8dc2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:27.962870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:27.970413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:27.971266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:27.972047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:27.980202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 54/101] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:27.987792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.061630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 48/102] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:28.063348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51844e-e7ce-47ac-bc3a-3423e445910b None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.063846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51844e-e7ce-47ac-bc3a-3423e445910b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.064452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51844e-e7ce-47ac-bc3a-3423e445910b None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.066126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 49/103] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:28.071497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.072091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.072554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.103863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:28.105061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:28.165809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2097d5-be36-4075-8883-c345a322eb60 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.208387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.209470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.209960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.210414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.211347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:28.212141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:28.214834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:28.230911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 55/104] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:28.231746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.253095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 50/105] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:28.256062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.356053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020703-43da-4ac3-aa35-00e2561b4212 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.396482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.397641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.398116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.398578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.400199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:28.403050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:28.405581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 56/106] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:28.407477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.484538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617d69a-9c1e-4b07-b1d2-43ab25dc9867 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.517312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.518193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.518474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.518747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] PATH_INFO: `/v3/users/8214c38cbdce4fa2bc8efd37e8114236` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.533707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] RBAC: Authorizing `identity:get_user(user_id=8214c38cbdce4fa2bc8efd37e8114236)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:28.534455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3ee3-9a1c-48c5-88db-a7e9481ab913 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.535174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:28.539802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 51/107] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:28 2022] GET /identity/v3/users/8214c38cbdce4fa2bc8efd37e8114236 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:28.539802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.572393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.573195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.573548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.573794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.584813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-1932dba0-a8da-4fd2-81d7-2ce0ae8ede16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:28.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:28.593637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:28.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 57/108] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:28.595673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5c5c-0b59-489a-8669-4f869e83bb9d None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.595673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5c5c-0b59-489a-8669-4f869e83bb9d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.595891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5c5c-0b59-489a-8669-4f869e83bb9d None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.597273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 58/109] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:28.597819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5c5c-0b59-489a-8669-4f869e83bb9d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.664476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054ea7-6656-4114-b0ef-4d6351b280ac None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.699253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.700189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.700640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.701068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.701914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:28.703779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5c5c-0b59-489a-8669-4f869e83bb9d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:28.704410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:28.738293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 52/110] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:39:28 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:28.738293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:28.749989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:28.750656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:28.750936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:28.751207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:28.894509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:28.896046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d11c-68ff-45df-80b0-55448a54c909 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:28.950846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9bc4-18bd-431c-8815-2e4dfa075326 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.008412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.009016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.009296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.009572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.010325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:29.010637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.012057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61d483-6d67-421d-b0c6-07c5589d64ab None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.022389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 53/111] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.023667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.024090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.024368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.042264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:29.043243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 59/112] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:29.047729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:29.047878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea245-d2ca-4d93-8542-efe544847edf None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.047878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea245-d2ca-4d93-8542-efe544847edf None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.047878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea245-d2ca-4d93-8542-efe544847edf None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.049287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 60/113] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:29.052598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea245-d2ca-4d93-8542-efe544847edf None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.117281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 54/114] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:29.118487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.159649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea245-d2ca-4d93-8542-efe544847edf None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.191363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.192275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.192556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.192828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.194050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.195494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa3fa-6da0-42fb-8612-f5a2a48f811a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.197137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 61/115] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.198273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.198554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.198821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.219522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:29.220731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:29.231908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee3170-cb12-47bc-9026-0e6165ebf7ad None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.264489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.265258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.265532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.265804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.266960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.268459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81c353-4885-40ac-b6eb-9ebbd65348a3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.270117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 55/116] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.276351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c821-9c4e-4643-af7b-9084f61712dd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.276626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c821-9c4e-4643-af7b-9084f61712dd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.276914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c821-9c4e-4643-af7b-9084f61712dd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.282165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 56/117] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:29.282165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c821-9c4e-4643-af7b-9084f61712dd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.293050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 62/118] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:29.293946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.388645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c821-9c4e-4643-af7b-9084f61712dd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.389100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1d05-a1fb-4232-80d5-13ebbbb63a6c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.422037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.422909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.423147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.423441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.424912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.425781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.426060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.426335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.427508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.429048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.430723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 63/119] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.434284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:29.436278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-83547ef8-7f62-4711-ab53-3b2d4b2d5852 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:29.443187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:29.444471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:29.445577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 57/120] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:29.446536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.446602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.446842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.463290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:29.464488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:29.528342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 58/121] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:29.529438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.546909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ccf2d-c64a-4a2f-b5fb-f0527775cf8e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.580373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.581422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.581843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.582231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.583264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=8214c38cbdce4fa2bc8efd37e8114236) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:29.583908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.586484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.594925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 64/122] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/role_assignments?user.id=8214c38cbdce4fa2bc8efd37e8114236&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.595655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.637706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14c0a-33ca-4816-b872-195ee3732ba2 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.676914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.678735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.679398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.679970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.692109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:29.701607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:29.702673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:29.703438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:29.704185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 59/123] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:29.705264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.714720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b33d-8080-404b-892f-f0692256b080 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.749974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.750929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.751212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.751481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/155689b863d044f782598840d769a7ed/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.753589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, user_id=155689b863d044f782598840d769a7ed, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.755075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.774949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 65/124] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:29 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/155689b863d044f782598840d769a7ed/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:29.776080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.834573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfef63-be0e-4e52-924a-a49c99185812 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.872336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.873017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.873296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.873570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.874334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:29.874641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:29.876322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:29.885109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 60/125] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:29.885951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:29.895303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8dc1e-4448-48aa-8eeb-2978c8819f1f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.939728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:29.940959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:29.941457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:29.941931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:29.965691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:29.982337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:29.983313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:29.984116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:29.986562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 66/126] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:29.988367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968115f7-7aaa-4e42-8bbe-05cf35817239 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:29.988914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.024713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.025399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.025682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.025959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.026721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:30.027028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.028675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.037682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 61/127] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.038264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.111266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dbef1-b938-4717-977f-92a83d4761a5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.137683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285304-6e92-42c8-9a73-8909997ccc66 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.145326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.146548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.147035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.147508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.148938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.150577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.152512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 67/128] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:29 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.153587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.170345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.171018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.171302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.171581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.172395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:30.172663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.174052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.182383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 62/129] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.183308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.253291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dfb25-19ac-4403-8589-6012274fb3b0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.278675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c662-033d-4997-aa08-cfb5610df96e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.286799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.288038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.288531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.288991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.290387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.292092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.294012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 68/130] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.295072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.311546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.312448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.312731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.313006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.314192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.315636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.317365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 63/131] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.318534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.393213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e1d9-57b7-4114-8352-e0017be4c9fb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.413292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b6af3-e0e4-4e16-8e56-5be6b2bc3ec6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.426707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.427999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.428495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.428994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.430387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.432065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.433910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 69/132] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.434915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.446042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.446912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.447195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.447741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.448707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.450168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.451885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 64/133] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.452649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.534845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90cf51-03a3-44ee-91ef-51b09bd5c129 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.554337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15613-2bff-4e45-89ea-6084e128da61 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.569030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.570223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.570723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.571210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.573594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, user_id=6de2d4f4e1ca4bf487457c92fe35f9cf, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.575247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.604150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 70/134] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:30 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:30.604338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.605164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.605419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.605696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] PATH_INFO: `/v3/projects/8d225288c9d041688e924d660be6c571` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.606118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.607074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] RBAC: Authorizing `identity:get_project(project_id=8d225288c9d041688e924d660be6c571)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.608772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.611758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 65/135] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:30 2022] GET /identity/v3/projects/8d225288c9d041688e924d660be6c571 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:30.619868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:30.731545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed57c8-c429-455b-beb3-052678977717 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.785713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40506d-2ccf-4cb0-bbd9-1fb34af6215d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:30.792891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551df739-04d3-495c-812d-2f77025f370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.793802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df739-04d3-495c-812d-2f77025f370d None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.794084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df739-04d3-495c-812d-2f77025f370d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.794359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df739-04d3-495c-812d-2f77025f370d None admin] PATH_INFO: `/v3/projects/8d225288c9d041688e924d660be6c571/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.797584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df739-04d3-495c-812d-2f77025f370d None admin] RBAC: Authorizing `identity:create_grant(project_id=8d225288c9d041688e924d660be6c571, user_id=6de2d4f4e1ca4bf487457c92fe35f9cf, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.799068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df739-04d3-495c-812d-2f77025f370d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.821122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 66/136] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:30 2022] PUT /identity/v3/projects/8d225288c9d041688e924d660be6c571/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:30.846141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:30.847073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:30.847353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:30.847628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:30.852886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, user_id=6de2d4f4e1ca4bf487457c92fe35f9cf, role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:30.854525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9767f-93ce-4a0f-a156-14e8d9e08b37 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:30.886839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 71/137] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:30 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/6de2d4f4e1ca4bf487457c92fe35f9cf/roles/3cc7ef3638714f57a89fac869553e946 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:31.759004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b6d7-d584-4cf5-b188-c15a1f823a03 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:31.759521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b6d7-d584-4cf5-b188-c15a1f823a03 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:31.759595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b6d7-d584-4cf5-b188-c15a1f823a03 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:31.760964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 67/138] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:31.766176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:31.766469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:31.766748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:31.788848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:31.790037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:31.877023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 72/139] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:31.916987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9b6d7-d584-4cf5-b188-c15a1f823a03 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:32.027477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9b6d7-d584-4cf5-b188-c15a1f823a03 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:32.064777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:32.065575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:32.065856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:32.066130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:32.067427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:32.068979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5046-5b49-4db2-b299-5dd10cc9788f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:32.070686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 68/140] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:32.076302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:32.173088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67123c-b784-4c08-b665-fe17557cb508 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:32.206354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:32.207034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:32.207312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:32.207583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:32.208331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:32.209847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4fc9c-a916-44b3-8eec-598faaa2c69f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:32.239565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 73/141] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:32 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:39:32.624690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a075c-dcd5-44d3-87eb-cbe4c74db12d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:32.625111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a075c-dcd5-44d3-87eb-cbe4c74db12d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:32.625296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a075c-dcd5-44d3-87eb-cbe4c74db12d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:32.626876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 69/142] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:32.633530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:32.633817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:32.634094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:32.655840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:32.657020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:32.738290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 74/143] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:32.769673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a075c-dcd5-44d3-87eb-cbe4c74db12d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:32.872238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a075c-dcd5-44d3-87eb-cbe4c74db12d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:32.906686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:32.907485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:32.907776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:32.910454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:32.921411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-dd10ecd6-81fb-4c68-b54e-601276383e9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:32.930962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:32.931880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:32.933101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 70/144] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:32.938325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.000518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600063-6fc8-401c-a4d5-50c8bdb00291 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.000844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600063-6fc8-401c-a4d5-50c8bdb00291 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.001066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600063-6fc8-401c-a4d5-50c8bdb00291 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.002436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 71/145] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:33.007551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.007860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.008141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.026933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:33.028140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:33.083303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83acf6-5704-4051-a6c5-b08fc5880ccd None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.129899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 72/146] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:33.142924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.143609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.143992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.144267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.145026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:33.145331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.146820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.158738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.173990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 75/147] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:33.180525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.284915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b9fe-3a73-47f5-ae37-b8f1c3b6f783 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.347677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.348509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.348789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.349063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.360125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:33.360542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf963d7-c7f3-4edd-a9e7-ad0204a817dc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:33.368133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:33.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:33.370593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 73/148] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:33.381040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.435427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.436593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.436887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.437161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] PATH_INFO: `/v3/users/8214c38cbdce4fa2bc8efd37e8114236` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.443741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] RBAC: Authorizing `identity:get_user(user_id=8214c38cbdce4fa2bc8efd37e8114236)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.445307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.446990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 76/149] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/users/8214c38cbdce4fa2bc8efd37e8114236 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:33.452820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.574536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ba76-f787-499e-a857-8202c9ae5b87 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.615891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cee55-0559-435f-ba89-aa09bf2fa876 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.666014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.667059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.667559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.668068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.669044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:33.669576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.671486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.678652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.679571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.679995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.680175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.683750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.685685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.687458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 77/150] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:33.688344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 74/151] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:33.693557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.695194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.832537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfcf8-8ea3-4677-aa27-7e948eb54451 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.844917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bc4f1-1fe2-4a99-82fb-56566f132b5d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:33.867326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.868893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.869371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.869875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] PATH_INFO: `/v3/users/155689b863d044f782598840d769a7ed` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.871295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] RBAC: Authorizing `identity:get_user(user_id=155689b863d044f782598840d769a7ed)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.872989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.874875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 75/152] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/users/155689b863d044f782598840d769a7ed => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:33.880458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:33.915562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:33.916864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:33.917350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:33.917807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/8214c38cbdce4fa2bc8efd37e8114236/roles/828fe8a87f2b4c47af2d4ccd623c8885` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:33.921272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, user_id=8214c38cbdce4fa2bc8efd37e8114236, role_id=828fe8a87f2b4c47af2d4ccd623c8885)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:33.922942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5602-fb89-4a1b-87a9-9a606a8c7cdb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:33.956647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 78/153] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:33 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/users/8214c38cbdce4fa2bc8efd37e8114236/roles/828fe8a87f2b4c47af2d4ccd623c8885 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:34.009868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940562-b8fe-4435-a720-8574a4acb22f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.045734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.046758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.047269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.047736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.085912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb6fb-70a9-4ef6-a49e-66c9222e8ee8 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.086230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb6fb-70a9-4ef6-a49e-66c9222e8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.086458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb6fb-70a9-4ef6-a49e-66c9222e8ee8 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.087910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 79/154] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:34.095521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.095823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.096097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.119604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:34.121460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:34.132628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:34.133598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:34.223844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 76/155] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:39:34.229025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:34.267260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 80/156] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:34.310472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:34.336829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5f45-ad68-4ddb-b4c0-246bf6066406 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.385075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.386359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.386886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.387361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.389672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:34.391335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:34.401643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 77/157] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:34.406174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:34.494073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f87db-ea97-450b-83c0-be860bd54e93 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.540421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.541239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.541513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.541778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.558373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:34.561620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea13a2-3e4e-4584-afd3-de47e39331c9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:34.571039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:34.572012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:34.572786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 81/158] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:34.581753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:34.610599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.611683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.612249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.612737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.613763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=155689b863d044f782598840d769a7ed) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:34.614268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:34.616014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:34.627456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 78/159] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/role_assignments?user.id=155689b863d044f782598840d769a7ed&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:34.692278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de501-cdd1-4d05-93d5-09505e8618aa None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.727866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.728550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.728826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.729100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.729853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:34.730151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:34.731602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:34.741251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 82/160] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:34.746812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:34.890707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdee4-4b30-4cf5-9547-6181b7014df3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:34.931271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:34.932429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:34.932871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:34.933389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:34.934763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:34.936396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8af0-58d5-4d14-b6c5-14c0b6672eac None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:34.938200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 79/161] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:34.948883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.072147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56b3e-90d0-410c-9b90-ddc5ccf74cc7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:35.107346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:35.108030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.108303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.108570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.175093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787d73-6cf7-454e-9d00-501201e5258d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.175426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787d73-6cf7-454e-9d00-501201e5258d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.175629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787d73-6cf7-454e-9d00-501201e5258d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.177196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 80/162] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:35.180493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:35.181971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:35.188136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.188426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.188676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.210983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:35.212191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:35.341756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 81/163] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:35.376110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 83/164] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:35.381875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.398032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.483497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263319b-f7b2-4b26-92d7-3891deb54f3b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:35.517311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:35.518213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.518491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.518759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.519946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:35.521497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9ea5-24fd-4d37-9482-0496eca67b11 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:35.523187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 82/165] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:35.524367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e599a2-f589-4e3a-b53e-4c7db54d25c7 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.524647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e599a2-f589-4e3a-b53e-4c7db54d25c7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.524915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e599a2-f589-4e3a-b53e-4c7db54d25c7 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.526316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 83/166] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:35.529937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e599a2-f589-4e3a-b53e-4c7db54d25c7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.631797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e599a2-f589-4e3a-b53e-4c7db54d25c7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:35.641667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01880e7d-1244-46b3-b374-4a499905de33 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:35.664814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:35.665520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.665794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.666063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.666934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:35.667245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:35.668709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e268-a977-4a40-817b-94e3d6f33e8b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:35.675008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 84/167] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=22c100d842ea400285feca8a56b61095 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:35.676071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.676348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.676610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.693955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:35.695171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:35.736496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:35.737319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.737598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.737866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.764624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 85/168] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:35.768969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:35.780997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:35.781973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:35.783253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 84/169] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:35.788035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.789920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:35.890421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e833e-8510-4ad6-8916-a99c3908c42f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:35.925962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:35.926766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:35.927039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:35.927303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:35.937687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:35.945931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:35.946889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:35.947665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 86/170] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:35.955832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.041115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87fe12-b764-4db6-93f9-6cece5b25802 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.062019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d35c7-8fc6-4b5a-bd8c-958cb429260d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.083004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.083891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.084178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.084500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.085259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:36.085564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.086948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.095481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 85/171] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:36.099183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.100198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.100477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.100748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.100917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.101606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:36.101906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.103288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.112903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 87/172] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:36.118687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.214839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7eb2-a3b8-4175-8b5b-12829fc550f7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.217185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34c27-c17a-4700-825b-0c788ac861ee None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.248834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.249890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.250164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.250433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.251415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.251710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.252613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.253032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.253174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.253589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] PATH_INFO: `/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.254929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] RBAC: Authorizing `identity:get_user(user_id=6de2d4f4e1ca4bf487457c92fe35f9cf)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.255286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 88/173] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:36.256824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.258693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 86/174] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/users/6de2d4f4e1ca4bf487457c92fe35f9cf => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:36.261064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.264472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.358809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd249c-94bb-46fa-93d2-a7231841bb17 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.368761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed43f0-2d6a-4531-ae08-4616a51a2db0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.393010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.393484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.393776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.394029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.409320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.410209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.410654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.411063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.461532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.462921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.481795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.483532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.557905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 89/175] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:39:36.563238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.584181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 87/176] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:39:36.589977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.660382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515625e-cb4a-4536-beb3-fe51566a2c94 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.692424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97128f56-6138-434e-8542-2ecb195d5828 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.693798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.694657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.694931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.695200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.696513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.697946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.699637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 90/177] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:36.705440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.728391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.729477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.729897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.730303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] PATH_INFO: `/v3/projects/8d225288c9d041688e924d660be6c571` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.731633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=8d225288c9d041688e924d660be6c571)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.733346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.735487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 88/178] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/projects/8d225288c9d041688e924d660be6c571 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:36.741382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:36.803262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06b62-4b8f-4f4a-8770-a8534da42ebb None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.836744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.837402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.837676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.837954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.838762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:36.839066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.840541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415818-0f70-43ff-90b4-99a0d915dc34 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.840699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd30d-e09e-4c69-a501-75aea8ef3cf2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:36.846428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 91/179] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=3cc7ef3638714f57a89fac869553e946 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:36.877568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:36.878540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:36.878975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:36.879447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:36.880571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=8d225288c9d041688e924d660be6c571, user.id=6de2d4f4e1ca4bf487457c92fe35f9cf) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:36.881033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:36.882733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b42f2-a186-423b-a1f7-139fb46d05e2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:36.889918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 89/180] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:36 2022] GET /identity/v3/role_assignments?user.id=6de2d4f4e1ca4bf487457c92fe35f9cf&scope.project.id=8d225288c9d041688e924d660be6c571&role.id=22c100d842ea400285feca8a56b61095 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:37.473972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7d38-1f8c-48d3-bc8a-ae286ec78736 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.474501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7d38-1f8c-48d3-bc8a-ae286ec78736 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.474501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7d38-1f8c-48d3-bc8a-ae286ec78736 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.476220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 92/181] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:37.481421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.481850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.482023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.496053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0fe70-37cc-42b8-8247-66b7028184a2 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.496342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0fe70-37cc-42b8-8247-66b7028184a2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.496594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0fe70-37cc-42b8-8247-66b7028184a2 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.498230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 93/182] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:37.503140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.503419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.503695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.508446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:37.509878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:37.521697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:37.522925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:37.592650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 94/183] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:37.599738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 90/184] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:37.617172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:37.627005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:37.728770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d186c7-0584-421f-95c3-a8d9f7bcea17 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:37.746819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ced50-bab0-4560-9d54-32336a49148e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:37.763267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:37.764371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.764791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.765292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.775474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-617892b9-f177-444e-966f-9e8d4b4cf5f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:37.783508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:37.784423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:37.785208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:37.785800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:37.785800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.785961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 95/185] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:37.786028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.786028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.786150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276877bc-d5bc-4f5e-9c01-5679670a92f8 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.786263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276877bc-d5bc-4f5e-9c01-5679670a92f8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.786537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276877bc-d5bc-4f5e-9c01-5679670a92f8 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.788003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 96/186] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:37.792490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276877bc-d5bc-4f5e-9c01-5679670a92f8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:37.803950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-26d970a2-2b59-46de-b22f-b0a7531870ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:37.816931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:37.817926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:37.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 91/187] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:37.821080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.821368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.821988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.840205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:37.841749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:37.902343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276877bc-d5bc-4f5e-9c01-5679670a92f8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:37.907251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 92/188] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:37.908113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:37.938423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:37.939091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:37.939380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:37.939651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:37.940462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:37.940761 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:37.942148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:37.950098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 97/189] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:37.950701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.022993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15246a5-6063-4e88-9ac4-54c27ed7dbf4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.049166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031f6c-36ca-42d7-9d21-8a428a6c0aee None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.054028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.054689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.054964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.055263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.056028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:38.056322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.057694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.065242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 93/190] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.066020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.080929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.081731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.082067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.082341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.083494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.085041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a79d-da1c-43c2-941d-f61372ec4d2d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.086775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 98/191] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.087789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171336-c643-4f5a-adb8-4470c00d2c44 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.088089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171336-c643-4f5a-adb8-4470c00d2c44 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.088359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171336-c643-4f5a-adb8-4470c00d2c44 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.089604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 99/192] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:38.090284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f171336-c643-4f5a-adb8-4470c00d2c44 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.167194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984d3-c4d4-479c-8ad3-e2b83c87abe5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.186272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f171336-c643-4f5a-adb8-4470c00d2c44 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.199568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.200483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.200762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.201032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.214705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.216200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.217896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 94/193] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.222492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.222569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.222569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.222569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.222569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.223357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.224868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c381b-7638-4ffa-9458-6e922efd0b14 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.226628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 100/194] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.227732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.228044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.228317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.245504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:38.246756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:38.307796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 101/195] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:38.308556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.329256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098293-917f-4f86-bb19-0ba562f1fc07 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.362730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.363397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.363672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.363976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.364672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.366150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.385858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 95/196] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:38 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:38.386908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.418177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa8e4-bbe2-44eb-a2a1-581fcc3f08d9 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.457225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.457932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.458188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.458451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.499186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68f73-0366-48fc-850c-a83e3af823e1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.530945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.532457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.533065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.533731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.534013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.534316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.603023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.604559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.639377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 102/197] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:38.639377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.724299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 96/198] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:38.725141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.760366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8faf6a-dbc5-4000-9438-8ecf53dda69c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.793908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.794911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.795286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.795628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.806032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:38.814851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:38.815780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:38.816590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 103/199] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:38.817270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.844518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c686aa-4121-4531-8615-48f9010476fd None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.886524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.887798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.888970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.889387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.890742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.892385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.894632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 97/200] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.895538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:38.923494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e417e-1651-48f8-a27a-c80fa39e29f2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:38.957127 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:38.957996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:38.958278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:38.958586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:38.960111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:38.961469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:38.967892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 104/201] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:38.968784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:39.013468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff79c9b-5b23-42ca-9b06-9f5b570db1a6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.051064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.051739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.052066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.052392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.053148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:39.053452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:39.054827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:39.062723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 98/202] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:39.063598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:39.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c734-c50c-45c0-90b6-7616a4796fe9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.118377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.119581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.120255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.121088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.122357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=14ea1844a8dd49e099ddfd5f3475e2f2) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:39.122978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:39.125162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:39.132559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 105/203] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:38 2022] GET /identity/v3/role_assignments?user.id=14ea1844a8dd49e099ddfd5f3475e2f2&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=3cc7ef3638714f57a89fac869553e946 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:39.133607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:39.161542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b5fb1-5923-4b5a-a19f-5ad664ab4b65 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.209781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.210460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.210742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.211019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.211883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=14ea1844a8dd49e099ddfd5f3475e2f2) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:39.212182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:39.213666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:39.221656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 99/204] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:39 2022] GET /identity/v3/role_assignments?user.id=14ea1844a8dd49e099ddfd5f3475e2f2&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:39.316860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b47351-1c9d-4056-a44e-3369ca3abc27 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.368038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.369545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.370014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.370456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] PATH_INFO: `/v3/users/8214c38cbdce4fa2bc8efd37e8114236` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.376848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] RBAC: Authorizing `identity:get_user(user_id=8214c38cbdce4fa2bc8efd37e8114236)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:39.378403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:39.380302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 106/205] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:39 2022] GET /identity/v3/users/8214c38cbdce4fa2bc8efd37e8114236 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:39.386634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:39.547276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764210a-c887-47f4-b064-a6cd774dbbd8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.593288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.593944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.594229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.594517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.685836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:39.687574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:39.793635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 100/206] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:39.800913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:39.951162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335199fa-00d8-4a74-8b78-365d59ffc958 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:39.996138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:39.997010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:39.997294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:39.997571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:39.998746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:40.000227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018443-bfc5-48bf-9fed-d3768f2b017c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:40.002091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 107/207] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:39 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:40.007876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:40.136453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419f8f-addb-45c6-8fb3-baaf3dcadea8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:40.189356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:40.190387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:40.190851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:40.191329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:40.192388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682, user.id=8214c38cbdce4fa2bc8efd37e8114236) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:40.192951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:40.194600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917372-4fb0-4739-8ec3-44eb8128d651 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:40.204201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 101/208] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:40 2022] GET /identity/v3/role_assignments?user.id=8214c38cbdce4fa2bc8efd37e8114236&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:41.015975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c355-177f-4f83-9d7a-10ce6340f48d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.016497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c355-177f-4f83-9d7a-10ce6340f48d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.016497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c355-177f-4f83-9d7a-10ce6340f48d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.018227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 108/209] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:41.023691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8b6c-5123-4904-936d-ce4d6bf81b6d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.024131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8b6c-5123-4904-936d-ce4d6bf81b6d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.024315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8b6c-5123-4904-936d-ce4d6bf81b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.040869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-236c8b6c-5123-4904-936d-ce4d6bf81b6d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:41.042025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-236c8b6c-5123-4904-936d-ce4d6bf81b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:41.111883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 102/210] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:41.130269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c355-177f-4f83-9d7a-10ce6340f48d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.142854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d5e1-88a9-4d49-be76-b22678ddd3e1 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.143147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d5e1-88a9-4d49-be76-b22678ddd3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.143401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d5e1-88a9-4d49-be76-b22678ddd3e1 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.144999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 103/211] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:41.150069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.150359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.150633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.167304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:41.168599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:41.236601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c355-177f-4f83-9d7a-10ce6340f48d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.247969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 104/212] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:41.263449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.271205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.272315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.272794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.273260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.284273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:41.292437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:41.293346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:41.294177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:41.296882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 109/213] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:41.305094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.365110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7a93-d406-49c2-873c-46235caa039f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.398163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.399079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.399258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.399500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.400665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:41.402116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:41.403702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 105/214] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:41.405841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96088-e4d6-4197-86fd-48bdc708008d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.409243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.440222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.440852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.441135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.441411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.442218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:41.442552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:41.444066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:41.457262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 110/215] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:41.458313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.515055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3769f-f5b2-4d38-a241-8eeebcf2972b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.548398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.549479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.549946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.550402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.551298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:41.552995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:41.560303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a24511-7879-4bbb-8479-6d2a4a71f3fa None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.578816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 106/216] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:41 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:41.605703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.606842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.607266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.607706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] PATH_INFO: `/v3/users/3f912ecc05e245e8b1d3733469d9015e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.624004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] RBAC: Authorizing `identity:get_user(user_id=3f912ecc05e245e8b1d3733469d9015e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:41.625786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898cd62-e4ec-4c64-bbd0-d1d5df9134b2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:41.627919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 111/217] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/users/3f912ecc05e245e8b1d3733469d9015e => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:41.634309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.660502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf98-6582-4e86-8d1e-ca47b5510bad None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.661125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf98-6582-4e86-8d1e-ca47b5510bad None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.661579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf98-6582-4e86-8d1e-ca47b5510bad None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.663322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 112/218] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:41.671320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.671642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.673092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.694539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:41.696391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:41.765133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00066-6aa8-430b-aeec-d577a409434c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.791837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 113/219] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:41.805582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.806163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.806447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.806722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.820698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:41.879804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:41.879804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c69d-8c13-48d6-a2cd-d0c70798db52 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:41.941577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084856-cc49-467f-ae7c-1c9d4072f810 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:41.981059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:41.981877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.982152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.982416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.993070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:41.995885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 107/220] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:39:41.997217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979f5c-03b0-483d-9e77-68a61b486922 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:41.997504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979f5c-03b0-483d-9e77-68a61b486922 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:41.997776 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979f5c-03b0-483d-9e77-68a61b486922 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:41.999165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 108/221] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1742b5b9-80ba-4959-a6c8-0fa393a5bbfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:42.001913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:42.002788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:42.003572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 114/222] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:42.004421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979f5c-03b0-483d-9e77-68a61b486922 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.007749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.008055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.008330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.024714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:42.025881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:42.090422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 115/223] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:42.091181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.110990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979f5c-03b0-483d-9e77-68a61b486922 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.144838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.145709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.146048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.146328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.147514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.148986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.150675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 109/224] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:42.151746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.198888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839aca-9def-470d-8914-9df35e35cf71 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.235536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.236506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.237311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.237769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.238997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:42.239464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.241642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.252137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 116/225] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:42.253126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.263819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926688b3-76b3-4b5f-8c20-5db1fc932916 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.306064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.307139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.307425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.307697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.320484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:42.329837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:42.330937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:42.331811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 110/226] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:42.332469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.365525 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6de1-4521-419d-aa33-0e2788ddadb2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.407514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.408197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.408477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.408750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.409579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=3f912ecc05e245e8b1d3733469d9015e) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:42.409886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.411825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.419044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 117/227] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/role_assignments?user.id=3f912ecc05e245e8b1d3733469d9015e&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=22c100d842ea400285feca8a56b61095 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:42.419997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.436943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179853-f5de-4b99-874c-e7db3119e407 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.473177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.474587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.475052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.475525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.477006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.478636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.480542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 111/228] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:42.486230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.531155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d11b-4371-48f5-a871-27806595b646 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.575275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.576005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.576317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.576596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.577365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:42.577674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.579705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.597352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 118/229] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:42.601435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91b385-efcc-4987-aa69-a53dcf48a2e3 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.602705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.674423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.675478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.676361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.676361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.677935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.679873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.682954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 112/230] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:42.693032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:42.813633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b6f9-d833-43ad-92a0-0c309579988f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.818396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983d65-b1dd-40e5-b26c-a2b45664fdcd None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:42.862598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.863556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.863868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.864141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/users/14ea1844a8dd49e099ddfd5f3475e2f2/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.868991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, user_id=14ea1844a8dd49e099ddfd5f3475e2f2, role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.871276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.890569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:42.891456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:42.894058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 113/231] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:42 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/users/14ea1844a8dd49e099ddfd5f3475e2f2/roles/3cc7ef3638714f57a89fac869553e946 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:39:42.894235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:42.894602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:42.896060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:42.897684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:42.899854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 119/232] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:42.907146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:43.053911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea933f9-f42b-475d-aa79-9eb2bea15650 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:43.092663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:43.093540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:43.093818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:43.094088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:43.095287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:43.096789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be1b5-9270-461b-80e9-50968868ea99 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:43.098476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 114/233] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:42 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:43.104385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:43.206119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2034cfe-a7c8-44b9-9740-3e48abab6043 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:43.243116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:43.244047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:43.244325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:43.244597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/users/14ea1844a8dd49e099ddfd5f3475e2f2/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:43.246687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, user_id=14ea1844a8dd49e099ddfd5f3475e2f2, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:43.248199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e6cf-062d-4b39-8d65-9a49e0d8768d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:43.265270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 120/234] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:43 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/users/14ea1844a8dd49e099ddfd5f3475e2f2/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:44.588091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db49-01b0-4db9-857d-f8c4b841bd00 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:44.588583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db49-01b0-4db9-857d-f8c4b841bd00 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:44.588583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db49-01b0-4db9-857d-f8c4b841bd00 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:44.589896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 115/235] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:44.597094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:44.597574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:44.597649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:44.615600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:44.616818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:44.626729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672fb4-0085-478e-b598-14d2ac6d49e3 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:44.627037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672fb4-0085-478e-b598-14d2ac6d49e3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:44.627290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672fb4-0085-478e-b598-14d2ac6d49e3 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:44.628918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 116/236] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:44.641332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:44.641613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:44.641883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:44.672759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:44.673954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:44.685221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 121/237] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:44.711719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:44.806050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 117/238] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:44.819973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa76c-11e2-41dd-b7a3-cd70a16f6a63 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:44.846871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:44.854075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:44.854868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:44.855141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:44.855410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:44.858509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:44.860440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:44.862390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 122/239] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:44.868512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:44.973646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1c4b-57ee-4f3d-a539-bac28e5503fd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.012150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.012809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.013084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.013351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.014550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.016280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396fac3-5f46-4263-904e-c9fbbfbc40f0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.032466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe88e-20e1-436e-823b-63e0ec83d94e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.041296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 123/240] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:44 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:45.047799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdedc9-85f8-4a6b-9962-d45b97bee657 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.047799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdedc9-85f8-4a6b-9962-d45b97bee657 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.047799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdedc9-85f8-4a6b-9962-d45b97bee657 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.048912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 124/241] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:45.054694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.054996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.055258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.086450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:45.087698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:45.109643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.110372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.110649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.110918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.136729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:45.145392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:45.146535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:45.147374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 118/242] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:45.160286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.236780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 125/243] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:45.285679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.337883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbca7b-04fe-4d17-865c-ae26505a6e4f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.372223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.372825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.373188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.373376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.374126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:45.374428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.375835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.386291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 119/244] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:45.391400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.410759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018029-f6df-4925-90cb-efa008a843d5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.454995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.456304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.456775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.457425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.471554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:45.482568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:45.483576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:45.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 126/245] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:45.496494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.522355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bf43-eaab-4943-8e81-2e8af3253dbf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.571809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.572925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.573338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.573778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] PATH_INFO: `/v3/users/70c87b8a56664bc3a7f37b51c102bc39` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.588689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] RBAC: Authorizing `identity:get_user(user_id=70c87b8a56664bc3a7f37b51c102bc39)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.590888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.592897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 120/246] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/users/70c87b8a56664bc3a7f37b51c102bc39 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:45.599271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.620917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf594af-9fbd-438c-a6c6-6be085b8f938 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.654681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.655651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.656131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.656598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.657533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:45.657998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.659539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.668784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 127/247] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:45.674527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.705871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdde8d-5a8f-4610-8790-64c1023c3635 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.740992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.741638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.741921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.742193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.775587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8721b5b-4d09-404c-8203-ad11ba74e636 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.808725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.809892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.810159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.810518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.810983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] PATH_INFO: `/v3/users/3f912ecc05e245e8b1d3733469d9015e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.811663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.812495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] RBAC: Authorizing `identity:get_user(user_id=3f912ecc05e245e8b1d3733469d9015e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.814088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.816326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 128/248] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/users/3f912ecc05e245e8b1d3733469d9015e => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:45.822009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.912121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 121/249] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:45.917566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:45.920125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd42ab-1eec-4683-9199-6edfbc9c400b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:45.954852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:45.956083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:45.956565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:45.956998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:45.958433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:45.960138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:45.962444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 129/250] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:45.968614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:46.021725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69060e2-3b97-45db-8ee1-7e0367a0e2bd None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:46.055470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:46.056397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.056901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.056901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.058103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:46.059568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:46.061312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 122/251] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:45 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:46.067096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:46.072380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94db35-22c5-4af8-8673-e6ab176cf242 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:46.105107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:46.106352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.106840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.107320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/users/3f912ecc05e245e8b1d3733469d9015e/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.117215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, user_id=3f912ecc05e245e8b1d3733469d9015e, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:46.119287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d1961-e73c-4338-90eb-284b4a75e9c8 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:46.141978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 130/252] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:45 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/users/3f912ecc05e245e8b1d3733469d9015e/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:39:46.168455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea2de-f55f-419e-a375-72f8e9819184 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:46.205272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:46.205942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.206271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.206550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.207392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=70c87b8a56664bc3a7f37b51c102bc39) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:46.207705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:46.209302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d7cb-c9d6-478a-a591-f9d9800ad73d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:46.215338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 123/253] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:46 2022] GET /identity/v3/role_assignments?user.id=70c87b8a56664bc3a7f37b51c102bc39&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:46.361822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b24-0158-4238-9734-d0f20deed7bc None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.362112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b24-0158-4238-9734-d0f20deed7bc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.362378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b24-0158-4238-9734-d0f20deed7bc None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.364561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 131/254] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:46.370416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fc88-b863-40e0-b115-8a8a6a74a1ca None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.370767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fc88-b863-40e0-b115-8a8a6a74a1ca None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.371000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fc88-b863-40e0-b115-8a8a6a74a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.393332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-50e8fc88-b863-40e0-b115-8a8a6a74a1ca None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:46.394806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-50e8fc88-b863-40e0-b115-8a8a6a74a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:46.480070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 124/255] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:46.527715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc54b24-0158-4238-9734-d0f20deed7bc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:46.637992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc54b24-0158-4238-9734-d0f20deed7bc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:46.658643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71969b1f-badf-4d42-af43-0a4cc33f5ce5 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.659161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71969b1f-badf-4d42-af43-0a4cc33f5ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.659161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71969b1f-badf-4d42-af43-0a4cc33f5ce5 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.660590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 125/256] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:46.666394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.666676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.666951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.694945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:46.696163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:46.701339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:46.702163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.702444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.702718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.725949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:46.738318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:46.740420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:46.742592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:46.749893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 132/257] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:46.751595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:46.814072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 126/258] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:46.865775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:46.923787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b08b-56b6-4e46-86fa-51d8fe54feda None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:46.981608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:46.982286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:46.982568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:46.982842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:46.984053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:46.984361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:46.985755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:47.003335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 133/259] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:47.009759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.087321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47224-1c03-41f1-8801-b0b57d002ace None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.161081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.161935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.162217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.162543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:47.180553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d18b77-a63d-49b1-a7e2-4eb6f55d4e49 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.192547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:47.200313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:47.201194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:39:47.201984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:47.209359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 127/260] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:47.218208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.248508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.249400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.249676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.249951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:47.251260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:47.252747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:47.254857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 134/261] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:47.261248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.443903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d121f-0ec7-4c19-9d1f-672f29475a2f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.460838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576515-2464-4afc-adc0-f48b0cf2bd16 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.505650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.507643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.508770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.509762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:47.510713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:47.511558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:47.514469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:47.521257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.522722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.523492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.524276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:47.540086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 128/262] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:47.541311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.664144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:47.666393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:47.674292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb8bd1-a585-4d8d-9300-d8448745e0db None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.716613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.717751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.718174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.718586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] PATH_INFO: `/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:47.720136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea1844a8dd49e099ddfd5f3475e2f2)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:47.722971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:47.725840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 129/263] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/users/14ea1844a8dd49e099ddfd5f3475e2f2 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:47.731331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.899599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956db3b-a3e6-43ff-92d8-8fece264eb71 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:47.910308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 135/264] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:47.920925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:47.957137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:47.957799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:47.958074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:47.958432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.079135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:48.088688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:48.163461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900bc85-6688-4992-bb74-c74953193386 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:48.257799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:48.258665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.258938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.259207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.260439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:48.261894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:48.263579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 136/265] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:48.263685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 130/266] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:48.269218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:48.269674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:48.413859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb83ed6-22f3-44c0-aa7c-5bca50d3252f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:48.422758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eed2a-db8a-4263-b9fe-8be01550d6af None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:48.486212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:48.487340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.487745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.495961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:48.495961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.495961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.495961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.496524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=14ea1844a8dd49e099ddfd5f3475e2f2) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:48.496861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.497147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:48.498274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:48.498917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5fd8-4527-4266-8cf2-ab0e619aaa01 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:48.499728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:48.501668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 137/267] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:48 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:48.511427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 131/268] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:48 2022] GET /identity/v3/role_assignments?user.id=14ea1844a8dd49e099ddfd5f3475e2f2&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=3cc7ef3638714f57a89fac869553e946 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:48.512411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:48.621234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4edc1-317f-4d40-848b-1d2af4b09f47 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:48.660939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:48.661965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.662415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.662856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.663942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=14ea1844a8dd49e099ddfd5f3475e2f2) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:48.664422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:48.666482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435502-b3a3-44e6-a868-30111e1d6b74 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:48.673295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 138/269] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:48 2022] GET /identity/v3/role_assignments?user.id=14ea1844a8dd49e099ddfd5f3475e2f2&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:48.961352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e46f3-e7b0-4352-a122-9a24eaf15ac8 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.962343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e46f3-e7b0-4352-a122-9a24eaf15ac8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.962820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e46f3-e7b0-4352-a122-9a24eaf15ac8 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:48.964815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 132/270] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:48.971615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12830-abc8-4ce9-8612-13d66fd16b32 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:48.972180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12830-abc8-4ce9-8612-13d66fd16b32 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:48.972648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12830-abc8-4ce9-8612-13d66fd16b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.002034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-aad12830-abc8-4ce9-8612-13d66fd16b32 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:49.003641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aad12830-abc8-4ce9-8612-13d66fd16b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:49.097691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 139/271] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:49.129533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e46f3-e7b0-4352-a122-9a24eaf15ac8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.242700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4132e-6e8f-4dc5-9dc6-457fc614e745 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.243298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4132e-6e8f-4dc5-9dc6-457fc614e745 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.244326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4132e-6e8f-4dc5-9dc6-457fc614e745 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.246346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 140/272] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:49.252201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.252990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.253471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.273033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:49.274532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:49.278678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e46f3-e7b0-4352-a122-9a24eaf15ac8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.312418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.313215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.313494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.313768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.314923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:49.316636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:49.318529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 133/273] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:49.323999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.344706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 141/274] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:49.369227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.448609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0d25-da16-4643-bb70-e2ff220b4667 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.480435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930caf5a-9be5-4f40-9572-77c3b5a28333 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.485594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.486375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.486753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.487122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.487965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:49.489708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:49.517795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 134/275] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:39:49 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:39:49.526660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.527952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.528508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.529006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.542399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a84ea0ff-9654-4b15-a075-5f220abc5b2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:49.551492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:49.552713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:49.553532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:49.556186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 142/276] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:49.562524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.609623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d92c-4f4f-4c62-ba5c-1db202ecaff5 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.609950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d92c-4f4f-4c62-ba5c-1db202ecaff5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.610175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d92c-4f4f-4c62-ba5c-1db202ecaff5 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.611584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 143/277] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:49.617549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc36772-3f5f-4d71-82f1-de78a82a54ec None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.617831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc36772-3f5f-4d71-82f1-de78a82a54ec None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.618107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc36772-3f5f-4d71-82f1-de78a82a54ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.637172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ebc36772-3f5f-4d71-82f1-de78a82a54ec None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:49.638383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ebc36772-3f5f-4d71-82f1-de78a82a54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:49.684213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837f82-cc5e-4f16-8251-f49caf45e3a2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.719404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 144/278] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:49.721502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962ed1-78e1-458c-8232-bb0cacfceb24 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.721793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962ed1-78e1-458c-8232-bb0cacfceb24 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.722071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962ed1-78e1-458c-8232-bb0cacfceb24 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.723333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 145/279] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:49.725351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.726244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.726717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.726998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.727798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:49.728126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:49.729346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.729497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:49.729898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.730328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.738748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 135/280] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:49.741252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.750055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:49.751469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:49.827513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 146/281] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:49.828737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.858866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b232d-779b-4759-bb4f-9ad9e404cb48 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.900314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.901388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.901670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.901944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.912573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:49.921628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:49.922841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 136/282] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:49.923642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:49.943833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4e91-b243-4c6c-872a-18abb62f1f5f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:49.978297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:49.979631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:49.980154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:49.980622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] PATH_INFO: `/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:49.994999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd9e811a71c4efda8bcb0a36a3f3631)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:49.996789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:49.998833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 147/283] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:49.999877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.031421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7689794-412e-4615-b52c-8724db4e9cb4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.077147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.078795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.079531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.080024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.094136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:50.104494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:50.105428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:50.106232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:50.109170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 137/284] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:50.110606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.113019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2276b-ad38-40ba-8d8a-78d54352e751 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.147988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.148791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.149162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.149527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.150357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:50.150755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.152442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.160933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 148/285] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:50.162049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.210434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae711-356c-4cf3-b6bb-d1e96cafbb03 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.244545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.245600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.246079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.246524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.247520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, user.id=0bd9e811a71c4efda8bcb0a36a3f3631, scope.system=all) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:50.248086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.249726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.254942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 138/286] 10.222.0.11 () {56 vars in 1308 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/role_assignments?user.id=0bd9e811a71c4efda8bcb0a36a3f3631&scope.system=all&role.id=22c100d842ea400285feca8a56b61095 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:50.255974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.272457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007216-96a1-430d-a52e-f38416e80e6a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.330096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.330563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.330842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.331113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.331889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:50.332194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.333673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.355416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 149/287] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:50.361084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.364026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5eb326-f67d-429a-a03c-c4109509a8d7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.400369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.401626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.402167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.402631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] PATH_INFO: `/v3/users/70c87b8a56664bc3a7f37b51c102bc39` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.404176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] RBAC: Authorizing `identity:get_user(user_id=70c87b8a56664bc3a7f37b51c102bc39)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.405853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.408090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 139/288] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/users/70c87b8a56664bc3a7f37b51c102bc39 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:50.421004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.539165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607da9ff-7303-4b01-82b9-7ec4780eaf9d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.570717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdf0b-a489-49f6-ba2d-ed8227dd38df None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.579085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.581094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.584013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.584322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.585616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.587073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.591829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 140/289] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:50.596173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.632590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.633473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.633748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.634022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] PATH_INFO: `/v3/users/3f912ecc05e245e8b1d3733469d9015e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.636015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] RBAC: Authorizing `identity:get_user(user_id=3f912ecc05e245e8b1d3733469d9015e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.637479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.641101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 150/290] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/users/3f912ecc05e245e8b1d3733469d9015e => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:50.652776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:50.754489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc190-bb47-4f15-bf97-91f6e586ac8a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.787471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.788394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.788669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.788934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/users/70c87b8a56664bc3a7f37b51c102bc39/roles/828fe8a87f2b4c47af2d4ccd623c8885` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.790946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, user_id=70c87b8a56664bc3a7f37b51c102bc39, role_id=828fe8a87f2b4c47af2d4ccd623c8885)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.792480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:50.807494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 141/291] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:39:50 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/users/70c87b8a56664bc3a7f37b51c102bc39/roles/828fe8a87f2b4c47af2d4ccd623c8885 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:39:50.838195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60cd5-ba82-40e5-8067-fcba301224fc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:50.875386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:50.876080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:50.876359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:50.876632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:50.950061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:50.951520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:51.051737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 151/292] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:51.057767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:51.171577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a094f-4ef7-4ea1-b66e-52e7d921a2fe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:51.205470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:51.206333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:51.206609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:51.206880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:51.208070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:51.209603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514ad6-009d-46fa-9162-36d69d80143d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:51.211638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 142/293] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:51 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:51.218504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:51.347627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7623ad-ff91-402d-bbc5-5cc21ad6ea77 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:51.392278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:51.392942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:51.393220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:51.393491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:51.394330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=3f912ecc05e245e8b1d3733469d9015e) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:51.394636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:51.396160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aae75-46e8-47f7-aa99-751a2a0228e3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:51.408590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 152/294] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:51 2022] GET /identity/v3/role_assignments?user.id=3f912ecc05e245e8b1d3733469d9015e&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=22c100d842ea400285feca8a56b61095 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:52.149215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f669cd-d062-4dd8-9c9b-2364dc38b9d5 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.149726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f669cd-d062-4dd8-9c9b-2364dc38b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.149726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f669cd-d062-4dd8-9c9b-2364dc38b9d5 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.151252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01137b-a22d-4a0a-bf37-1d060355e791 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.151655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 143/295] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:52.151731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01137b-a22d-4a0a-bf37-1d060355e791 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.151731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01137b-a22d-4a0a-bf37-1d060355e791 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.153262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 153/296] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:52.157794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.158080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.158344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.158507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.158645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.158933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.177155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:52.178343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:52.180738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:52.181875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:52.247937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 144/297] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:52.255314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 154/298] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:52.271484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.285886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.383966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a149-24a6-48f5-a029-074f6cf9a533 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.389783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36399b2c-b976-478b-a6c4-2faaa7b182e6 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.416971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.417688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.417968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.418244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.419399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:52.420894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:52.422667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 155/299] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:52.428226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.430198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.431423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.432658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.433075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.445930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:52.456249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:52.457326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:52.458368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:52.461427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 145/300] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:52.467145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.538183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe0ae-c768-4547-abcf-87a5d18c78de None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.567532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad928752-9c1d-49cb-ab72-ad4bc24cef0a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.572616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.573523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.573997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.574887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] PATH_INFO: `/v3/groups` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.575802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:52.578153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:52.598975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 156/301] 10.222.0.11 () {60 vars in 1134 bytes} [Tue May 3 08:39:52 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:39:52.615165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.616304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.616783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.617634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.618720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:52.619270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:52.621070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:52.631542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 146/302] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:52.637246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.748399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b938c-b684-46bb-a758-128798b57389 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.784146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.785032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.785312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.785582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] PATH_INFO: `/v3/users/bd60e97dd2204ca8a973fd67f119ac83` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.799996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] RBAC: Authorizing `identity:get_user(user_id=bd60e97dd2204ca8a973fd67f119ac83)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:52.801529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671b76e-2ebd-4703-87cf-a601a89ddf98 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:52.803640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 157/303] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:52 2022] GET /identity/v3/users/bd60e97dd2204ca8a973fd67f119ac83 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:52.809424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:52.912468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a479a-621e-4fb8-8a5e-45aa364c4928 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:52.945973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:52.946696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:52.946973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:52.947291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:52.948156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, user.id=bd60e97dd2204ca8a973fd67f119ac83, scope.system=all) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:52.948461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:52.949906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb860d-b3f9-4d2e-8f4c-020ce5e2ec8b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:52.955505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 147/304] 10.222.0.11 () {56 vars in 1308 bytes} [Tue May 3 08:39:52 2022] GET /identity/v3/role_assignments?user.id=bd60e97dd2204ca8a973fd67f119ac83&scope.system=all&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:53.053124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54930-d4ee-48f2-b26f-859e6ac5b336 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.053340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54930-d4ee-48f2-b26f-859e6ac5b336 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.053596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54930-d4ee-48f2-b26f-859e6ac5b336 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.055271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 158/305] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:53.061019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337402d4-c056-4660-a854-13058449aea7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.061317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337402d4-c056-4660-a854-13058449aea7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.061654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337402d4-c056-4660-a854-13058449aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.079121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-337402d4-c056-4660-a854-13058449aea7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:53.080716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-337402d4-c056-4660-a854-13058449aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:53.151837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 148/306] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:53.174597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a54930-d4ee-48f2-b26f-859e6ac5b336 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.284071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a54930-d4ee-48f2-b26f-859e6ac5b336 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.318029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.318746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.319024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.319295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.329575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1dcae4e6-1697-4c31-aaba-6a68e6f63e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:53.337570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:53.338485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:53.339275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 159/307] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:53.345053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337402d4-c056-4660-a854-13058449aea7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.347756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed426106-aedb-4f0e-9a62-877d72632074 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.348076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed426106-aedb-4f0e-9a62-877d72632074 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.348351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed426106-aedb-4f0e-9a62-877d72632074 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.349986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 160/308] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:53.354897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.355179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.355450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.372182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:53.373335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:53.444993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 161/309] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:53.458453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337402d4-c056-4660-a854-13058449aea7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.467421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.493492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.494503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.495011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.495469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.496445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:53.496933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:53.498484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:53.507137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 149/310] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:53.512582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.592540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd56d-448e-443f-abba-3ee76a5275a5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.610728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d4e3-534c-48af-ad29-2776629550c8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.635786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.636932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.637403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.637850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.645879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.646755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.647031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.647354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] PATH_INFO: `/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.648851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] RBAC: Authorizing `identity:get_user(user_id=0bd9e811a71c4efda8bcb0a36a3f3631)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:53.649132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:53.650307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:53.652036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 150/311] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:53.657595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:53.658179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:53.659070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:53.659874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:39:53.667191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 162/312] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:39:53.668360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.763387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec907a3-5791-4700-9257-e6858c4e70cd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.778789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3137-22b9-41c1-92a2-087a86ab8ddf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.802372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.803053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.803338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.803617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.804407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:53.804713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:53.806764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:53.819839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 163/313] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:53.824406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:53.825691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.826743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.827110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.827506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] PATH_INFO: `/v3/system/users/0bd9e811a71c4efda8bcb0a36a3f3631/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.829723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0bd9e811a71c4efda8bcb0a36a3f3631, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:53.830587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:53.845895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 151/314] 10.222.0.11 () {58 vars in 1334 bytes} [Tue May 3 08:39:53 2022] PUT /identity/v3/system/users/0bd9e811a71c4efda8bcb0a36a3f3631/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:39:53.939660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c793a-6f8e-4eb7-82ee-cd4eedaf0bbf None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:53.976388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:53.977524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:53.977990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:53.978401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] PATH_INFO: `/v3/users/70c87b8a56664bc3a7f37b51c102bc39` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:53.980014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] RBAC: Authorizing `identity:get_user(user_id=70c87b8a56664bc3a7f37b51c102bc39)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:53.981648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:53.983926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 164/315] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/users/70c87b8a56664bc3a7f37b51c102bc39 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:53.995797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:54.089729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ca662-6241-4576-bf9d-3a6c8177faab None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:54.122455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:54.123027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:54.123304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:54.123570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:54.190894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:54.192447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:54.288561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 152/316] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:54.293591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:54.389132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8714d1-f55d-479e-9786-fb6ae2445ecc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:54.422515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:54.423738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:54.424262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:54.424731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:54.426110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:54.427839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e085ac-4409-4c09-b472-dac6141afe83 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:54.430052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 165/317] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:54 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:54.435499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:54.533522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec424b85-7b91-47a6-aac7-cbbadb650351 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:54.569433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:54.570478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:54.570946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:54.571404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:54.572456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, scope.project.id=99ee35849367440cbaca9d6969a17069, user.id=70c87b8a56664bc3a7f37b51c102bc39) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:54.572948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:54.574604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d07db-1e25-43bc-a043-e9b9553acb23 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:54.581321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 153/318] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:39:54 2022] GET /identity/v3/role_assignments?user.id=70c87b8a56664bc3a7f37b51c102bc39&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:54.956139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb44d-cb84-4843-84c3-539cbcadc467 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:54.956542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb44d-cb84-4843-84c3-539cbcadc467 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:54.956708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb44d-cb84-4843-84c3-539cbcadc467 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:54.958256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 166/319] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:54.963416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:54.963711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:54.964022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:54.980951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:54.982125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:55.051419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 154/320] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:55.073713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb44d-cb84-4843-84c3-539cbcadc467 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:55.180009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb44d-cb84-4843-84c3-539cbcadc467 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:55.217761 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:55.218566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.218847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.219109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.220310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:55.221748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ef7ba-cd24-4514-a4cc-c0932edd669b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:55.223537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 167/321] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:55.229230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:55.295721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab61e-a3eb-40ce-8c32-f94dc3371dae None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.296290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab61e-a3eb-40ce-8c32-f94dc3371dae None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.296290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab61e-a3eb-40ce-8c32-f94dc3371dae None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.297833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 168/322] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:39:55.302663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.302949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.303223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.321462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:55.322636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:55.330078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d952-4a8c-4e04-b90a-60241ca5b8b0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:55.363036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:55.363700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.364022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.364363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] PATH_INFO: `/v3/groups` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.365040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:55.366488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:55.381985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 155/323] 10.222.0.11 () {60 vars in 1134 bytes} [Tue May 3 08:39:55 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:39:55.393493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 169/324] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:55.416032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:55.518652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18d6f-b02a-4965-9d39-0a014ff0344a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:55.552694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:55.553510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.553788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.554055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.564671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:55.572391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:55.573468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:55.574459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:55.579361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 156/325] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:55.579727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:55.680458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c791e3-f3db-468f-a36b-dc511a78051c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:55.715520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:55.716223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.716499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.716772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.717518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:55.717818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:55.719214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:55.728483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 170/326] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:55.734150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:55.838293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343271-14f2-4bda-ba35-3ab6fc2b4180 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:55.881497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:55.882402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:55.882683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:55.882958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] PATH_INFO: `/v3/users/bd60e97dd2204ca8a973fd67f119ac83` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:55.884248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] RBAC: Authorizing `identity:get_user(user_id=bd60e97dd2204ca8a973fd67f119ac83)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:55.885716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45103e4-8e62-438f-ae2f-5b1704d1f32f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:55.887361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 157/327] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:55 2022] GET /identity/v3/users/bd60e97dd2204ca8a973fd67f119ac83 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:55.893144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:56.000039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c953e-83af-40f2-997a-a6f13e31c151 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:56.033923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:56.034804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.035082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.035360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] PATH_INFO: `/v3/system/users/bd60e97dd2204ca8a973fd67f119ac83/roles/828fe8a87f2b4c47af2d4ccd623c8885` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.037000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd60e97dd2204ca8a973fd67f119ac83, role_id=828fe8a87f2b4c47af2d4ccd623c8885)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:56.038521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918dc8d-6357-4da4-a898-4abe69f2b1b5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:56.050150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 171/328] 10.222.0.11 () {58 vars in 1334 bytes} [Tue May 3 08:39:55 2022] PUT /identity/v3/system/users/bd60e97dd2204ca8a973fd67f119ac83/roles/828fe8a87f2b4c47af2d4ccd623c8885 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:39:56.135398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a14f-c685-42d5-a82d-d6ad474be7b5 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.135590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a14f-c685-42d5-a82d-d6ad474be7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.135890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a14f-c685-42d5-a82d-d6ad474be7b5 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.137545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 158/329] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:56.142748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.143041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.143325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.161359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:56.162565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:56.257152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 172/330] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:56.281064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052a14f-c685-42d5-a82d-d6ad474be7b5 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:56.401566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052a14f-c685-42d5-a82d-d6ad474be7b5 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:56.437519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:56.438321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.438601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.438875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.449451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:56.457145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:56.459288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:56.461373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 159/331] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:56.468857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:56.593719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074b8a8-4752-43b2-ab47-06ce1fb81164 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:56.633393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:56.634080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.634366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.634639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.635394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:56.635698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:56.637106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:56.650295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 173/332] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:56.651733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:56.753729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ba2d3-c3ba-4ec1-877d-a594848cfcfd None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:56.789723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:56.790598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.790878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.791155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] PATH_INFO: `/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.792463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd9e811a71c4efda8bcb0a36a3f3631)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:56.793923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf82b9-e7c0-441a-88c3-d1c6dfecf216 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:56.795548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 160/333] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:56 2022] GET /identity/v3/users/0bd9e811a71c4efda8bcb0a36a3f3631 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:56.801444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:56.905116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660842fe-da73-4ad5-95e0-0b3df539e3c5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:56.943491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:56.944199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:56.944485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:56.944764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:56.945612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] RBAC: Adding query filter params (role.id=22c100d842ea400285feca8a56b61095, user.id=0bd9e811a71c4efda8bcb0a36a3f3631, scope.system=all) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:56.945925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:56.947391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f6c4-bcc9-48e9-8fa1-3e11cf196511 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:56.964419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 174/334] 10.222.0.11 () {56 vars in 1308 bytes} [Tue May 3 08:39:56 2022] GET /identity/v3/role_assignments?user.id=0bd9e811a71c4efda8bcb0a36a3f3631&scope.system=all&role.id=22c100d842ea400285feca8a56b61095 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:58.331888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ffb0-2ded-454a-9c33-da3ddc5d1e39 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.332399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ffb0-2ded-454a-9c33-da3ddc5d1e39 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.332483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ffb0-2ded-454a-9c33-da3ddc5d1e39 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.333898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 161/335] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:58.339492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509715-8d54-45eb-9365-c5887502e8a1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.340106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509715-8d54-45eb-9365-c5887502e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.340106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509715-8d54-45eb-9365-c5887502e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.361164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6a509715-8d54-45eb-9365-c5887502e8a1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:58.362350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6a509715-8d54-45eb-9365-c5887502e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:58.442136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 175/336] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:58.486052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8ffb0-2ded-454a-9c33-da3ddc5d1e39 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:58.530574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527d86-103d-490a-a60b-1f6eb2bc4ef0 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.530880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527d86-103d-490a-a60b-1f6eb2bc4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.531123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527d86-103d-490a-a60b-1f6eb2bc4ef0 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.532775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 176/337] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:58.537899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de29186-a5b0-486f-a390-29d58b68acc1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.538187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de29186-a5b0-486f-a390-29d58b68acc1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.538459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de29186-a5b0-486f-a390-29d58b68acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.566828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1de29186-a5b0-486f-a390-29d58b68acc1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:58.568095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1de29186-a5b0-486f-a390-29d58b68acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:58.616765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8ffb0-2ded-454a-9c33-da3ddc5d1e39 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:58.665085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:58.665901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.666184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.666458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.682464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:58.696123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:58.698244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:58.700188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 162/338] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:58.709498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:58.790134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 177/339] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:39:58.821880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4342e-5f3f-401c-80aa-1df78338c3ba None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.822206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4342e-5f3f-401c-80aa-1df78338c3ba None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.822443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4342e-5f3f-401c-80aa-1df78338c3ba None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.824082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 178/340] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:39:58.829430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.829711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.829988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.832982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d98001-3d1e-4a4f-8ad8-92df778d7aaa None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:58.851595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:39:58.852811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:39:58.878339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:58.879020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:58.879302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:58.879576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:58.880437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:58.880742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:58.882149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:58.891617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 163/341] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:39:58.892829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:58.937192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 179/342] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:39:58.938324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:58.996139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3b87-f60d-4d8d-9fe6-3244f6226f35 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.029882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.031058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.031556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.032079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.042924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1beee-121f-4813-b342-a11bbc1fdfd6 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.044675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:59.053196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:59.054116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:39:59.054922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:59.057631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 164/343] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:39:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:59.063101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.077088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.077620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.077905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.078181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.161128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.162868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.173338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4301e-dabb-4b21-9be7-11422511b374 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.228722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.229918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.230430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.230892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.252287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:39:59.263251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:39:59.264241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:39:59.265077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:39:59.268703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 165/344] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:39:59.271273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.333093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 180/345] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:39:59.336560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.447909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085261-bcfb-4daf-892a-7544ed7e9cce None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.484696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.485372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.485655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.485940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.487017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:59.487315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.488900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.498512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 181/346] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:59.498813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4464-2bb2-4c9c-9fb9-a7a068dca19b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.499412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.585506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.586116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.586398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.586675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.587444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:39:59.587751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.589200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.610391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 166/347] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:59.611095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.613413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5e5d-fa48-4af0-8e6a-e76ee907881e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.679928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.680807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.681085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.681360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.684246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.685718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.687465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 182/348] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:59.688326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.783224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bbd0-749f-44f2-a035-45255c505476 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.824783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4fbf-1d45-4bfc-8f8d-e9dc73446405 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:39:59.834996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.835985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.836211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.836486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] PATH_INFO: `/v3/users/bd60e97dd2204ca8a973fd67f119ac83` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.837980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] RBAC: Authorizing `identity:get_user(user_id=bd60e97dd2204ca8a973fd67f119ac83)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.839690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.842437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 167/349] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/users/bd60e97dd2204ca8a973fd67f119ac83 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:39:59.843212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:39:59.870501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:39:59.871527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:39:59.872056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:39:59.872521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:39:59.957005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:39:59.958624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077167b-469d-409c-847d-8f637afd8d32 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:39:59.972264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7e8ba-a381-4e53-b7aa-2c4a6b514b7e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.015395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.016733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.017276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.017757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.024792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.026572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910f935-d7e9-4625-8513-507b6c0dcf92 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.031254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 168/350] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.032861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5bb-956e-4e0b-b8dc-23a4876158d7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.033347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5bb-956e-4e0b-b8dc-23a4876158d7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.033833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5bb-956e-4e0b-b8dc-23a4876158d7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.035516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 169/351] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:00.036482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd5bb-956e-4e0b-b8dc-23a4876158d7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.083745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 183/352] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:00.088370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.088370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.088370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.106922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:00.108237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:00.160694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd5bb-956e-4e0b-b8dc-23a4876158d7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.178064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 184/353] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:00.178953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.218037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.218709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.218991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.219323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.220194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] RBAC: Adding query filter params (role.id=828fe8a87f2b4c47af2d4ccd623c8885, user.id=bd60e97dd2204ca8a973fd67f119ac83, scope.system=all) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:00.220593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.222063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.238743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 170/354] 10.222.0.11 () {56 vars in 1308 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/role_assignments?user.id=bd60e97dd2204ca8a973fd67f119ac83&scope.system=all&role.id=828fe8a87f2b4c47af2d4ccd623c8885 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.240025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.280309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3704fa-8e84-45a5-acdf-6346cbc6f66f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.316928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.317685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.317967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.318245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.319097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=22c100d842ea400285feca8a56b61095, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:00.319411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.320939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992815b9-97d5-4194-b8e9-99181ec7576c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.327531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 185/355] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=22c100d842ea400285feca8a56b61095 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.333257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab080-1d31-45b5-96a8-27bac0f45131 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.333563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab080-1d31-45b5-96a8-27bac0f45131 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.333824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab080-1d31-45b5-96a8-27bac0f45131 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.335524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 186/356] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:00.336318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab080-1d31-45b5-96a8-27bac0f45131 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.359517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475cc9-fba3-4106-9a03-e35602fede7e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.407694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.408703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.408987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.409260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.411947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.413449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4794-106e-4175-b9d9-44ecfc33bd9b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.415292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 171/357] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.418334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.418615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.418991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.456765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:00.458040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:00.537684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab080-1d31-45b5-96a8-27bac0f45131 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.554016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 172/358] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:00.555557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.577918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.578742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.579025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.579300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.594426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:00.602741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:00.603857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:00.604707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 187/359] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:00.605405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.673803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634705d-221a-4792-a481-f2e00ff6c55c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.718635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.719936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.720431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.720915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.721199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d107-8304-420f-8c41-1305ba69d9ca None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.722607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.724335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.726517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 173/360] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.727500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.755533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.756421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.756731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.757184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.767803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:00.776331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:00.777270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:00.778063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 188/361] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:00.778739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.831149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a445e-7628-4783-8c22-de4e53d9c0d5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.877065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.877880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.878021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.878274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.879091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:00.879400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.880940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.889407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 174/362] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.891652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:00.894847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4305-a882-4b3a-8486-34bca428d2e2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:00.932326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:00.932913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.933195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.933469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.934303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:00.934622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:00.936851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9666713-8684-489d-b7ec-c72e6f1f3c76 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:00.942157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 189/363] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=3cc7ef3638714f57a89fac869553e946 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:00.943479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c99-a28e-4332-a3e2-6c519ddb13f0 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:00.943793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c99-a28e-4332-a3e2-6c519ddb13f0 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:00.944071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c99-a28e-4332-a3e2-6c519ddb13f0 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:00.945392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 190/364] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:00.946124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2c99-a28e-4332-a3e2-6c519ddb13f0 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.014509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbeff-f384-4c01-ba1f-c869f6938226 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.050559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.051915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.052413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.052904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.053872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:01.054383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.055664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2c99-a28e-4332-a3e2-6c519ddb13f0 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.056146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34a3a-4f7a-42a5-93b1-4fe21905ab3c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.065687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 175/365] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:01.067410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.067876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.068284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.091192 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:01.092309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.092587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:01.092970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.093249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.093522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.164359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.164601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.188778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 176/366] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:01.189564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.290810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 191/367] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:01.291995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.306056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b77e-8ac0-41bb-b20d-e65ca334da19 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.340893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.341939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.342438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.342899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.390696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd928-e5fe-486c-b78b-4187fabe4429 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.411105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.412931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.427534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.428457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.428675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.428917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.440299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:01.448494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:01.449388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:01.450197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 192/368] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:01.454777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.516343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 177/369] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:01.517517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.556251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1409-51c2-49b5-8136-5d9ca306961e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.590268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.591230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.591467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.591953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.593207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.594705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.596795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 193/370] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:01.597334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.618539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c05cd-354b-4fcb-a79d-e891d742c7c6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.653577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.654614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.655089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.655574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.656549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:01.657060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.658635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.667642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 178/371] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:01.668776 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.703812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747174-3c54-4f6d-9ac9-864b3f48f747 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.737867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.738236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.738452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.738727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.740003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.741526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.744038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 194/372] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:01.744975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.788493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6163-bffc-4244-89b2-ee7e53f79b0a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.844161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.845043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.845324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.845599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.847290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.848877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:01.854698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 179/373] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:01.855491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:01.862629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754bac6-a703-42ed-9cae-ad94a19e291e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.901498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:01.902544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:01.903021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:01.903508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:01.978384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:01.979989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1089e2-dc1f-4dc5-9f68-6621a8219899 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:01.980464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.026792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.028134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.028630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.029114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.030476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.032349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.034193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 180/374] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:02.035122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:02.099856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 195/375] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:02.101069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:02.142788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c7731-fb2e-4f05-96d3-d3630db56666 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:02.179156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.180249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.180751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.181216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.182231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=22c100d842ea400285feca8a56b61095, scope.project.id=99ee35849367440cbaca9d6969a17069) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:02.182745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.184500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.190902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 181/376] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:02 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=22c100d842ea400285feca8a56b61095 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:02.192244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:02.208482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c78ac9-72c7-4007-ad2d-601c7f005bc5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:02.265526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.266126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.266410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.266728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.267526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=99ee35849367440cbaca9d6969a17069) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:02.267860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.269308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.276048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 196/377] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:02 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=3cc7ef3638714f57a89fac869553e946 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:02.310490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f92c3-7403-4f6f-a633-70f948437a00 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:02.350694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.352010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.352518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.353017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] PATH_INFO: `/v3/projects/a709989f94ec462eae85b1893e89377a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.354520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=a709989f94ec462eae85b1893e89377a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.356220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.358234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 182/378] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:02 2022] GET /identity/v3/projects/a709989f94ec462eae85b1893e89377a => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:02.364447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:02.472924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfb42-9587-410f-a22b-7a51bed0428f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:02.514291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.515517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.516094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.516578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] PATH_INFO: `/v3/groups/16cd8941072b4c188571f68264ab6cf8` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.526144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] RBAC: Authorizing `identity:get_group(group_id=16cd8941072b4c188571f68264ab6cf8)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.528163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbedd3-0b1a-4bb7-aed9-236c2926b8e6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.530569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 197/379] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:02 2022] GET /identity/v3/groups/16cd8941072b4c188571f68264ab6cf8 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:02.536778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:02.646869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973657-3ebb-47a4-b3c8-7f969dd27ad9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:02.681757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:02.682804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:02.683348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:02.683864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:02.684888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] RBAC: Adding query filter params (group.id=16cd8941072b4c188571f68264ab6cf8, role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=a709989f94ec462eae85b1893e89377a) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:02.685404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:02.687045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6953-35c1-4fa4-94a1-7800841a7586 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:02.693884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 183/380] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:02 2022] GET /identity/v3/role_assignments?group.id=16cd8941072b4c188571f68264ab6cf8&scope.project.id=a709989f94ec462eae85b1893e89377a&role.id=40264f46cb744114a960ef46085a53c3 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:03.144452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58be5-39fb-424f-a98b-e03eb20cb73c None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.145545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58be5-39fb-424f-a98b-e03eb20cb73c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.146027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58be5-39fb-424f-a98b-e03eb20cb73c None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.147922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 198/381] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:03.153122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.153664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.154151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.176084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:03.177735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:03.249955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 184/382] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:03.274692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58be5-39fb-424f-a98b-e03eb20cb73c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.404240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58be5-39fb-424f-a98b-e03eb20cb73c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:03.445383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:03.446181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.446459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.446728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.457417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-71d03c19-5a98-44e6-a57e-54aba65d0d84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:03.465123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:03.466028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:03.466835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 199/383] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:03.476916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.487341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef678c-0f12-4c40-8120-02b2dfc04f5e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.487623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef678c-0f12-4c40-8120-02b2dfc04f5e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.487955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef678c-0f12-4c40-8120-02b2dfc04f5e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.489627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 200/384] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:03.495107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.495389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.495664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.524768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:03.525951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:03.591501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f929-3a5a-4c88-bbf3-7ac17a8ec62e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:03.625884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:03.626569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.626851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.627125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.627895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:03.628196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:03.631789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:03.638496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 185/385] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:40:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:03.644873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.667670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 201/386] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:03.704627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.759273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2bc9-fd25-4fea-a511-1e28556df990 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:03.793140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:03.794014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.794297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.794574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.795839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:03.797220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:03.799216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 186/387] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:03 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:03.809427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.912535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329d52b-3e4a-41cf-82d6-c958a36aae39 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:03.916306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b2a8e-7a7b-492a-8771-5e71196358a3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:03.946489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:03.947742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.947881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.948242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:03.949531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:03.951069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:03.953307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 187/388] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:03 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:03.962420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:03.989437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:03.990506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:03.990921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:03.991398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.024691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:04.033140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:04.034058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:04.034848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:04.041920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 202/389] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:04.047307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:04.076690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd100a4-cbd2-40c2-984e-0020ade59d83 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:04.110497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:04.111393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:04.111721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:04.112018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.114302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, group_id=03a7cf4a5b9f4f5e938131056b81a460, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:04.115759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:04.134999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 188/390] 10.222.0.11 () {58 vars in 1442 bytes} [Tue May 3 08:40:03 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:40:04.196979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a0346-78f7-4e83-86d6-9138d1d53481 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:04.234735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:04.235708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:04.236180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:04.236769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.237676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:04.238122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:04.239796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:04.249404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 203/391] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:04.256918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:04.380599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e4d3-b1eb-41a2-94bf-0b9655651c10 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:04.426461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:04.427584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:04.428027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:04.428459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.429817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:04.431395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:04.433195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 189/392] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:04 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:04.438829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:04.548370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8996a-2ad7-449a-95c0-b9c8f9e590a4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:04.583034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:04.584258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:04.584681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:04.585098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.586435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:04.588064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79fa1-b4d9-4c8a-a3e2-23464537777b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:04.590381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 204/393] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:04 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:04.595975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:04.715241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c524-358b-4c13-98d8-9832c963aee7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:04.749972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:04.751125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:04.751553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:04.751981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:04.754283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1fb26fe2b54c48ad0571ceebd69682, group_id=03a7cf4a5b9f4f5e938131056b81a460, role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:04.755989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29affc25-2bb8-445b-b303-4255e53a9d0c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:04.771145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 190/394] 10.222.0.11 () {58 vars in 1442 bytes} [Tue May 3 08:40:04 2022] PUT /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/3cc7ef3638714f57a89fac869553e946 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:40:05.122278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18070-367b-4702-8b96-c8caf593101d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.122800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18070-367b-4702-8b96-c8caf593101d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.123209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18070-367b-4702-8b96-c8caf593101d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.125036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 205/395] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:05.131139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.131429 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.131707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.149730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:05.150905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:05.229488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 191/396] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:05.262662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d18070-367b-4702-8b96-c8caf593101d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:05.381007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d18070-367b-4702-8b96-c8caf593101d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:05.424299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:05.425504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.425970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.426573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.438624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-b301f903-76b3-48bb-af81-901f927746e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:05.446925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:05.452137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:05.452956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:05.455455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 206/397] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:05.461096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:05.598715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af341d4-1ddb-4a0f-b449-2acc7d06c9c8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:05.623431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55626-8b2d-46e1-a3cc-e34e31f95776 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.624160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55626-8b2d-46e1-a3cc-e34e31f95776 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.624623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55626-8b2d-46e1-a3cc-e34e31f95776 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.626627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 207/398] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:05.632255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.632867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.633328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.655799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:05.655799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.655799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.655799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.656207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:05.656207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:05.656207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:05.665465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:05.666657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:05.671054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 192/399] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:05.676565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:05.778386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 208/400] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:05.782609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cfc0-b888-40a0-a9d4-0c4741a2775f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:05.813409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:05.819535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:05.820446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.820725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.820998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.827807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:05.827807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:05.827807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 193/401] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:05 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:05.833193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:05.930385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6d781-26c8-4528-9416-79b2954a4cb0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:05.965196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:05.966065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.966345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.966614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.968672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:05.970419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d8233-1323-4f70-823b-44c5b58d5060 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:05.977351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 194/402] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:05 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:05.977351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d18d6-c5ca-4ad8-8b40-89d644787067 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:05.977351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d18d6-c5ca-4ad8-8b40-89d644787067 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:05.977351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d18d6-c5ca-4ad8-8b40-89d644787067 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:05.977351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 195/403] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:05.978527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d18d6-c5ca-4ad8-8b40-89d644787067 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.005773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5132-c60b-42e7-b436-a1a0114c912d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.048881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.050596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.051076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.051753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.067506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-0771954c-03a0-41f0-a00a-f4cc9454b57b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:06.077746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:06.078713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:06.079522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:06.080751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 209/404] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:06.083014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.083299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.085485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.105163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d18d6-c5ca-4ad8-8b40-89d644787067 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.106822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:06.108869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:06.143070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.144022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.144357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.144625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.147853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, group_id=03a7cf4a5b9f4f5e938131056b81a460, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.149313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.170484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 196/405] 10.222.0.11 () {58 vars in 1442 bytes} [Tue May 3 08:40:05 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:40:06.171388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.189033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 210/406] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:06.227350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.352236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7581c0-131f-4425-8d5b-7739246d06b4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.394958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.395815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.396102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.396375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.409131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:06.418116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:06.419041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:06.419887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 211/407] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:06.426149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.428103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4baecc-265c-4b73-9ef6-576e8ae4e515 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.468690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.469292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.469613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.469874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.470588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:06.470893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.472310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.481886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 197/408] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:06.487059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.546176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d8e0-d064-4fe7-92d8-6465aa2d3a06 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.579224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab225-207d-435d-a983-d1130b84edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.579926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab225-207d-435d-a983-d1130b84edca None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.580207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab225-207d-435d-a983-d1130b84edca None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.580481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab225-207d-435d-a983-d1130b84edca None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.581226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab225-207d-435d-a983-d1130b84edca None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:06.581530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab225-207d-435d-a983-d1130b84edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.583007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab225-207d-435d-a983-d1130b84edca None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.591679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 212/409] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:06.599048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab225-207d-435d-a983-d1130b84edca None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.676823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76e3a-0a66-4cb5-bf6c-07d4659a4e1f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.747792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.748589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.748870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.749148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.750349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.752762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.754446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 198/410] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:06.761031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.783077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab225-207d-435d-a983-d1130b84edca None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.846293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.847160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.847442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.847717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] PATH_INFO: `/v3/groups/16cd8941072b4c188571f68264ab6cf8` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.849674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] RBAC: Authorizing `identity:get_group(group_id=16cd8941072b4c188571f68264ab6cf8)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.851137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.852796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 213/411] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/groups/16cd8941072b4c188571f68264ab6cf8 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:06.860826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:06.910243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbe615-1404-4975-84fb-41f6338cc9c5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:06.950052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:06.950929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:06.951256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:06.951533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:06.952770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:06.954225 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:06.956378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 199/412] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:06.962528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.063561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ea147-704e-4ae1-9814-bb1e08cd5cc7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:07.130122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:07.131011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.131291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.131565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] PATH_INFO: `/v3/projects/a709989f94ec462eae85b1893e89377a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.134551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a709989f94ec462eae85b1893e89377a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:07.136084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:07.138095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 214/413] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:06 2022] GET /identity/v3/projects/a709989f94ec462eae85b1893e89377a => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:07.146636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e48b-d48b-45d4-b1e2-72bbefd7a6eb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:07.149024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.219343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532142-2532-458b-8908-4c26017fac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:07.220446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532142-2532-458b-8908-4c26017fac6c None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.220731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532142-2532-458b-8908-4c26017fac6c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.221002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532142-2532-458b-8908-4c26017fac6c None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.223856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532142-2532-458b-8908-4c26017fac6c None admin] RBAC: Authorizing `identity:create_grant(project_id=99ee35849367440cbaca9d6969a17069, group_id=03a7cf4a5b9f4f5e938131056b81a460, role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:07.225380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532142-2532-458b-8908-4c26017fac6c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:07.261598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 200/414] 10.222.0.11 () {58 vars in 1442 bytes} [Tue May 3 08:40:06 2022] PUT /identity/v3/projects/99ee35849367440cbaca9d6969a17069/groups/03a7cf4a5b9f4f5e938131056b81a460/roles/3cc7ef3638714f57a89fac869553e946 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:07.306070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b769da-72c8-4fc7-8de9-fbde5d9b57d9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:07.320223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc53d4-e512-48a4-9bbc-f6c99c22cb7f None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.320502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc53d4-e512-48a4-9bbc-f6c99c22cb7f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.320697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc53d4-e512-48a4-9bbc-f6c99c22cb7f None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.322336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 201/415] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:07.330393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.330724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.331209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.353557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:07.354453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.354729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.354999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] PATH_INFO: `/v3/projects/a709989f94ec462eae85b1893e89377a/groups/16cd8941072b4c188571f68264ab6cf8/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.357173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] RBAC: Authorizing `identity:create_grant(project_id=a709989f94ec462eae85b1893e89377a, group_id=16cd8941072b4c188571f68264ab6cf8, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:07.358743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:07.365529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:07.366721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:07.377172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 215/416] 10.222.0.11 () {58 vars in 1442 bytes} [Tue May 3 08:40:07 2022] PUT /identity/v3/projects/a709989f94ec462eae85b1893e89377a/groups/16cd8941072b4c188571f68264ab6cf8/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:07.480405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 202/417] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:07.519067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.666006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86023fc-4239-47a3-8821-6847d8fefb7a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:07.699521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:07.700345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.700622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.700890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.711245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-4333731e-1c86-42cc-9f9b-ab86c817ef5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:07.718915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:07.719852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:07.720640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 216/418] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:07.727479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.745522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3e91-3030-4f1d-8744-16985068924b None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.745806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3e91-3030-4f1d-8744-16985068924b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.746072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3e91-3030-4f1d-8744-16985068924b None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.747685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 217/419] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:07.755219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.755500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.755798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.788803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:07.789986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:07.830920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36d87-3bb3-4670-95ba-e5bb06fc6085 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:07.870343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:07.871382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:07.871883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:07.872371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:07.873343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:07.876564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:07.878180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:07.887357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 203/420] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:07.893000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.905464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 218/421] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:07.955404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:07.999403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b578-584d-4120-9cf4-ff53cbeac1c4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.044454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577c10-8350-4803-a452-b70bf342234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.045484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577c10-8350-4803-a452-b70bf342234f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.045979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577c10-8350-4803-a452-b70bf342234f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.046439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577c10-8350-4803-a452-b70bf342234f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.081786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581d045-2433-460a-b39e-4c2021237d10 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.118403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.119207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.119482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.119756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.140742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:08.151104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:08.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:08.152811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:08.158713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 219/422] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:08.161859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:08.195485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77577c10-8350-4803-a452-b70bf342234f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.196991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77577c10-8350-4803-a452-b70bf342234f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.314662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 204/423] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:08.320873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577c10-8350-4803-a452-b70bf342234f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:08.351373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8230c4-9399-486f-9e01-1fb705e96911 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.432485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.433283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.433474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.433567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577c10-8350-4803-a452-b70bf342234f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.433718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.434439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:08.434739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.436144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.455104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 220/424] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:08.471041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.472396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.472574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.472841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.473496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:08.474193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.475751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.477715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 205/425] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:08.482939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:08.582051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310fab3-7c93-4cd6-84c0-7071a1fb4fe4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.618023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.618892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.619169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.619441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.620637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.622080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.636170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 206/426] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:08.636170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:08.670238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f483bf-2cc6-4fc3-b05b-86a805b28db0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.727267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba89277-e3d9-4908-9180-1abf54d43cd8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:08.729732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.730680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.731169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.731661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.763797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:08.764461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.764758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.765000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.765828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=22c100d842ea400285feca8a56b61095, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:08.766133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.767565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692e2d3-7337-40a1-90b0-694c495ce9bd None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.773794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 207/427] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=22c100d842ea400285feca8a56b61095 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:08.775003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88256c-0cea-4fb6-84e1-945710c825fb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.775288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88256c-0cea-4fb6-84e1-945710c825fb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.775560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88256c-0cea-4fb6-84e1-945710c825fb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.777164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 208/428] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:08.784187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:08.784523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:08.784744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:08.816346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:08.820236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:08.850551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:08.854017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:08.959900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 209/429] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:08.979184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.032651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 221/430] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:40:09.040485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.115731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5fe7d-d379-4a7e-b6fc-ad0970571691 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.154575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.155373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.155649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.155966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.170521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:09.171365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5b989-3823-4d3d-b613-0e7f5fdaed1b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:09.180095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:09.181014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:40:09.181830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:09.182447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 210/431] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:09.188093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.216517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.216517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.216517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.216517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] PATH_INFO: `/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.217467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1fb26fe2b54c48ad0571ceebd69682)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.223790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.223790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 222/432] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/projects/9c1fb26fe2b54c48ad0571ceebd69682 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:09.226138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.318914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6913-22bb-4135-8b00-49d7ecb5068e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.338914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592765-33bd-4527-b2be-0a6a1271ceb4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.362832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.363926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.364403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.364903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.365837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:09.366332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.368250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.375075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.375075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.375075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.375075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.375443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.376641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.378564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 223/433] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:09.384384 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 211/434] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:09.385547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.390075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.494094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795096-404a-41ac-9a9a-b524399e1fc9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.527502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fdb69-d9b2-41b5-9e43-fe70fa4ef667 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.534804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.535982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.536267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.536546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.567159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.567852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.568133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.568405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.569440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:09.569639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.571109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.577572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 224/435] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=9c1fb26fe2b54c48ad0571ceebd69682&role.id=3cc7ef3638714f57a89fac869553e946 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:09.612003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.613484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.719346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 212/436] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:09.725164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.842390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e634f7-9bb2-45d9-80ad-c0f79aa0ef81 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:09.875155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:09.876060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.876339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.876610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.877859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:09.879412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e98eb-f056-43bd-acbb-9eba84995981 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:09.881564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 225/437] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:09.887134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:09.944189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e3ab-1744-4066-b54a-b18d10a729fc None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.944805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e3ab-1744-4066-b54a-b18d10a729fc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.945272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e3ab-1744-4066-b54a-b18d10a729fc None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.947108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 226/438] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:09.952505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:09.953031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:09.953499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:09.975741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:09.977209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:10.003587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ef5a-1851-4b0e-8e68-ab7b088adb5c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.042651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.043569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.043907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.044185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.045365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.046807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.048844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 213/439] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:09 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:10.054497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.062826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 227/440] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:10.086440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.155562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2dd05-376a-491b-854f-e047131f50fb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.183748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc869754-30f8-4833-a278-d4d2067ce94b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.195261 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.196396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.197237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.197711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.198962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=22c100d842ea400285feca8a56b61095, scope.project.id=99ee35849367440cbaca9d6969a17069) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:10.199603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.201627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.209633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 214/441] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=22c100d842ea400285feca8a56b61095 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:10.219169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.220044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.220325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.220596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.233425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-88b0aa32-c3e6-4aae-b8d9-70bd7f1de90d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:10.241818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:10.243110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:10.248883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 228/442] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:10.249590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.270452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53c8a-0d63-4f5e-af60-f547ecc3edca None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.270801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53c8a-0d63-4f5e-af60-f547ecc3edca None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.270995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53c8a-0d63-4f5e-af60-f547ecc3edca None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.272599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 229/443] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:10.278112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.278435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.278656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.299090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:10.300373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:10.358333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40eee6-56f7-41df-82c4-fca31021bf66 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.370438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 230/444] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:10.393348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.394639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.395745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.396304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.396577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.398167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:10.398167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.399073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.407872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 215/445] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:10.412930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.501759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae440b3-093a-44c4-a93e-f6ef609ede47 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.521156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9f6b-b65c-4468-8d23-a0ae1a179d02 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.540939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.541730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.542017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.542287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.554296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:10.555741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.556476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.556756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.557026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:10.562672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:10.563583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:10.564402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 231/446] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:10.570184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.627038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.628535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.667055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d4d96-5f8d-4b67-858a-674b382b32bc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.698319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.698970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.699254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.699528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.700303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:10.700616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.701998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.709756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 232/447] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:10.715273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.720935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 216/448] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:10.726452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.809270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeca770-a946-4142-8282-2aaec28e66de None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.820544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2981c-ab4b-4823-bb0f-f60fc41e0cf9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.844009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.844635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.844884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.845154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.852473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.853348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.853622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.853886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] PATH_INFO: `/v3/projects/99ee35849367440cbaca9d6969a17069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.855059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] RBAC: Authorizing `identity:get_project(project_id=99ee35849367440cbaca9d6969a17069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.856532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.858190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 217/449] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/projects/99ee35849367440cbaca9d6969a17069 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:10.863742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:10.910356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:10.911897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:10.962569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25939-3664-40de-a76f-6c42d664c54f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:10.996610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:10.997496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:10.997784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:10.998083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] PATH_INFO: `/v3/groups/03a7cf4a5b9f4f5e938131056b81a460` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:10.999248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] RBAC: Authorizing `identity:get_group(group_id=03a7cf4a5b9f4f5e938131056b81a460)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:11.000718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:11.002284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 218/450] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/groups/03a7cf4a5b9f4f5e938131056b81a460 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:11.004181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 233/451] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:40:11.008498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:11.009989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:11.103656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967602-9518-44a6-868f-36e8156bf10b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:11.106962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68a8-617b-4d96-b6cc-97634e552683 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:11.135044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:11.135959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:11.136226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:11.136486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] PATH_INFO: `/v3/projects/a709989f94ec462eae85b1893e89377a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:11.137681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] RBAC: Authorizing `identity:get_project(project_id=a709989f94ec462eae85b1893e89377a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:11.139095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:11.140851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 234/452] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:40:11 2022] GET /identity/v3/projects/a709989f94ec462eae85b1893e89377a => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:11.141936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:11.142560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:11.142835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:11.143105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:11.143954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] RBAC: Adding query filter params (group.id=03a7cf4a5b9f4f5e938131056b81a460, role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=99ee35849367440cbaca9d6969a17069) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:11.144258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:11.145988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:11.146367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:11.151746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 219/453] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:11 2022] GET /identity/v3/role_assignments?group.id=03a7cf4a5b9f4f5e938131056b81a460&scope.project.id=99ee35849367440cbaca9d6969a17069&role.id=3cc7ef3638714f57a89fac869553e946 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:11.248461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56b89-0f3e-4858-9524-a701141a9c9d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:11.283996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:11.284858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:11.285138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:11.285401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] PATH_INFO: `/v3/groups/16cd8941072b4c188571f68264ab6cf8` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:11.286703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] RBAC: Authorizing `identity:get_group(group_id=16cd8941072b4c188571f68264ab6cf8)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:11.288254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c921-5cc1-495c-94ba-6e165f8b11a0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:11.289924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 235/454] 10.222.0.11 () {56 vars in 1180 bytes} [Tue May 3 08:40:11 2022] GET /identity/v3/groups/16cd8941072b4c188571f68264ab6cf8 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:11.296170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:11.409175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83780b9-7f05-4f84-bcf5-ff6d0431109b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:11.444157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:11.444851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:11.445129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:11.445372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:11.446198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] RBAC: Adding query filter params (group.id=16cd8941072b4c188571f68264ab6cf8, role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=a709989f94ec462eae85b1893e89377a) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:11.446539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:11.448089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415e3e-5b1c-4558-80da-aec7937ecfa5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:11.454102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 220/455] 10.222.0.11 () {56 vars in 1376 bytes} [Tue May 3 08:40:11 2022] GET /identity/v3/role_assignments?group.id=16cd8941072b4c188571f68264ab6cf8&scope.project.id=a709989f94ec462eae85b1893e89377a&role.id=40264f46cb744114a960ef46085a53c3 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:14.093861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84a92-47ea-4e0a-8968-797e86e024cf None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.094400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84a92-47ea-4e0a-8968-797e86e024cf None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.094400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84a92-47ea-4e0a-8968-797e86e024cf None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.096088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 236/456] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:14.102171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47402-aaeb-4c36-804c-57831e7556cb None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.103014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47402-aaeb-4c36-804c-57831e7556cb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.103430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47402-aaeb-4c36-804c-57831e7556cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.126483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-98b47402-aaeb-4c36-804c-57831e7556cb None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:14.127944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-98b47402-aaeb-4c36-804c-57831e7556cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:14.210645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 221/457] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:14.243083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad84a92-47ea-4e0a-8968-797e86e024cf None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.322123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0588-779a-4b47-beb3-3740c7f863fd None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.322407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0588-779a-4b47-beb3-3740c7f863fd None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.322683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0588-779a-4b47-beb3-3740c7f863fd None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.324305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 222/458] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:14.329358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105aaf-c3b6-4bc8-a7ac-c47dd5470b4c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.329889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105aaf-c3b6-4bc8-a7ac-c47dd5470b4c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.330376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105aaf-c3b6-4bc8-a7ac-c47dd5470b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.346883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a8105aaf-c3b6-4bc8-a7ac-c47dd5470b4c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:14.348393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a8105aaf-c3b6-4bc8-a7ac-c47dd5470b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:14.373370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad84a92-47ea-4e0a-8968-797e86e024cf None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:14.426810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:14.427649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.427975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.428247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.438875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:14.440542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:14.455518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 223/459] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-5baafa13-090a-4f66-87f5-101d49b97c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:14.458224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:14.459122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:14.460072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:14.460072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:14.460072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.460072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:14.462207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 237/460] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:14.463653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d482-e33b-4094-b934-f6278df1b926 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.464038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d482-e33b-4094-b934-f6278df1b926 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.464385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d482-e33b-4094-b934-f6278df1b926 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.465885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 224/461] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:14.471208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d482-e33b-4094-b934-f6278df1b926 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.472033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.472513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.473030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.507904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:14.509475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:14.573877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d482-e33b-4094-b934-f6278df1b926 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:14.583866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 238/462] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:14.584972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.608095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:14.608530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.608879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.609227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.610010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:14.610381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:14.611850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:14.623633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 225/463] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:14.629040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.696439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc3f1a-6d66-4b1b-a4f1-307a6848c793 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:14.729885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:14.730821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd8c1-d601-4bab-9b9d-57028e9abfb4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:14.731285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.731811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.732288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.744205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:14.746064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:14.765607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:14.766599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:14.767436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:14.767436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:14.767436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.767436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:14.768132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:14.768820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.769103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.769371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.770135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:14.770851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 239/464] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:14.771587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:14.776704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.799960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 226/465] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:14 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:40:14.801021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.883166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f669cc-d412-47a8-b363-906c9773f525 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:14.921979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:14.923316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.923854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.924500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.941017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:14.943817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1447f1bd-83cf-480d-95e3-b953c8a4b5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:14.969162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:14.970098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:14.970966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:14.970966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:14.970966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:14.970966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:14.973870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 240/466] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:14.975620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d97d-6dbe-41e7-84e0-ce6a3d05c01e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:14.976129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d97d-6dbe-41e7-84e0-ce6a3d05c01e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:14.976621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d97d-6dbe-41e7-84e0-ce6a3d05c01e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:14.978509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 241/467] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:14.980756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2d97d-6dbe-41e7-84e0-ce6a3d05c01e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:14.983402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b16d-67c6-483a-9c31-8b55234b0063 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.019526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.020343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.020628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.020964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.021707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:15.022063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.023610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7229-e842-4546-8f43-8b8148605cfc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.042305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 227/468] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:15.043669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.043987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.044270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.064145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:15.066166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:15.102132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2d97d-6dbe-41e7-84e0-ce6a3d05c01e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.143832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.144217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 228/469] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:15.144676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.144885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.146100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.146206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.146206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:15.146341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.147663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.159635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 242/470] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:15.166434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.281213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfb8-aed4-4e3c-b100-993a5a66618d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.285317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4b0ba-1865-49a7-b2b5-ce0313908109 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.322341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.322939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.323218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.323485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.324212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.325929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.327741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.328786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.329288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.329749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.330630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.332314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.347268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 229/471] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:15.351920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.367470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 243/472] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:15.463433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac5c9-266a-4291-8d24-c1032dab44b2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.505565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.506389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.506663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.506933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.518842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.520434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-63635646-6fa8-45f5-a909-9440579adba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:15.540328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:15.541243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:15.542085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:15.542085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:15.542085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:15.542085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:15.542085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 230/473] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:15.547847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.665469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b2fd-1805-47fa-b794-287a62e70d49 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.679491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd0f1-b2dd-4e35-8193-c9942e4480a0 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.680261 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd0f1-b2dd-4e35-8193-c9942e4480a0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.680379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd0f1-b2dd-4e35-8193-c9942e4480a0 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.683805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 231/474] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:15.687291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.687699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.688093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.707350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.708056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.708374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.708657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.709383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:15.709686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.710128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:15.711082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.711301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:15.726573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 244/475] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:15.730966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.803267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 232/476] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:15.828374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:15.839333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2505-8a9a-4a7d-ba50-22cb4b85238d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:15.875047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:15.875047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:15.875462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:15.875636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:15.876353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:15.877776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:15.906607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 245/477] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/users => generated 249 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:40:15.963293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c16da-3c27-4a9a-9cad-0655bc04cd30 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:16.016670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:16.017280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:16.017559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:16.017832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:16.018610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:16.020136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:16.031275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.sql.core [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:40:16.031275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 08:40:16.031275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [parameters: {'id': '0ce3fd2c43d649ed9452ba6994d3db05', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 08:40:16.031275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:40:16.054458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return ref.to_dict() May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:40:16.055410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application yield resource May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise self.value May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application session.commit() May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:40:16.056348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.flush() May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application compat.raise_( May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:40:16.057212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:40:16.058303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:40:16.059138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [parameters: {'id': '0ce3fd2c43d649ed9452ba6994d3db05', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:16.061196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 08:40:16.063097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:16.065072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 233/478] 10.222.0.11 () {60 vars in 1131 bytes} [Tue May 3 08:40:15 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:16.071619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:16.189003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad1d-052a-434d-900a-3d649a692241 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:16.225949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:16.226775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:16.227055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:16.227334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:16.237725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-5a1b3daf-de7f-4522-a1e0-6e62e09a2202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:16.246056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:16.246914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:16.247720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 246/479] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:16.253089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:16.369176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe6d4-5da2-4054-86c2-876c0e37f416 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:16.410744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:16.411466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:16.411743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:16.412052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:16.412802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:16.413102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:16.414604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7be0c5-3d22-4681-ade9-ae0b51ca5836 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:16.423412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 234/480] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:17.755482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233894ec-a6c1-4cf3-bd08-f95f68e2c338 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:17.756534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233894ec-a6c1-4cf3-bd08-f95f68e2c338 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:17.757041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233894ec-a6c1-4cf3-bd08-f95f68e2c338 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:17.758869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 247/481] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:17.764242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:17.765042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:17.765504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:17.782260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:17.783717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:17.865117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 235/482] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:17.900647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233894ec-a6c1-4cf3-bd08-f95f68e2c338 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.012241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233894ec-a6c1-4cf3-bd08-f95f68e2c338 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.045442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.046630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.047109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.047560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.058174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-2d496a80-c948-4adc-ac08-727267e5a54b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:18.066090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:18.067003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.067920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:18.070547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 248/483] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:18.076471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.086071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02258f7-1230-41f5-8837-5ba1493ff2fa None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.086366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02258f7-1230-41f5-8837-5ba1493ff2fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.086618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02258f7-1230-41f5-8837-5ba1493ff2fa None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.089282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 249/484] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:18.093241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.093524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.093800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.121417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:18.124314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:18.243203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b755-6afc-4e2b-86f2-cedd1f8bd675 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.248875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 250/485] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:18.295213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.295821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.296101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.296383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.297110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:18.297408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:18.298783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:18.310958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 236/486] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:18.312230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.323970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.477380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3d7ba-952b-4044-938b-1a633893ec16 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.489576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd49-6785-4c3d-af93-3739f3a6b2a4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.535552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.536366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.536644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.536922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.540800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.541858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.542329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.542810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.547712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:18.549146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:18.555893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-28135fc0-cd99-4285-955b-051bbfe10f2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:18.565076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:18.565969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.566916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-538e61bb-8634-42b3-9033-c9a4dcce8980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:18.567518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:18.568312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:18.569174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:18.569174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:18.569174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:18.569174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:18.569174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 251/487] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:18.574555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687051-7664-4a75-998d-e2cbbebb9611 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.574555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687051-7664-4a75-998d-e2cbbebb9611 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.574555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687051-7664-4a75-998d-e2cbbebb9611 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.576103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 252/488] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:18.576790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 237/489] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:18.576915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687051-7664-4a75-998d-e2cbbebb9611 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.580685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.580968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.581467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.603740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:18.604946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:18.680268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 238/490] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:18.683378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.701557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687051-7664-4a75-998d-e2cbbebb9611 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.750696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.751953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.752705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.753177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.754228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:18.754730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:18.757260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:18.776149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 253/491] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:18.777341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.801758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f62db-17e0-4c6c-95fb-2ba5bac715bf None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.834213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.834892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.835231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.835444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.836220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:18.836525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:18.837938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:18.846232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 239/492] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:18.848145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.877715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec35b6-4bab-4bd0-b68d-82b3abf114c2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.910552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.911344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.911621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.911928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.921671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1c98027b-be15-4934-87e8-44aa1130cdee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:18.929420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:18.930516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:18.931330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 254/493] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:18.932025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc5b0-5861-4ac9-8aa5-c43840d6267e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.932091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc5b0-5861-4ac9-8aa5-c43840d6267e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.932375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc5b0-5861-4ac9-8aa5-c43840d6267e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.937567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 255/494] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:18.938199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc5b0-5861-4ac9-8aa5-c43840d6267e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:18.953702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc59ff-be8f-426d-9d3a-8d48a2343e99 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:18.985249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:18.986046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:18.986326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:18.986598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:18.994514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:18.996246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:19.011539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:19.012524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:19.013437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 240/495] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:19.014015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.037988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc5b0-5861-4ac9-8aa5-c43840d6267e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.069569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.070289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.070576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.070851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.081230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.082754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-5e5bf657-4d0c-4971-9e1f-e0b883c8bb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:19.101332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:19.102281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:19.103132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:19.103132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:19.103132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:19.103132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:19.107485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 256/496] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:19.108974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.109259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.109569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.117745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482bb68-b529-41f5-a650-dfe62610174d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.126828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:19.130370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:19.155699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.156532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.156927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.157035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.157808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:19.158083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.159493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.172214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 241/497] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:19.172214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.215803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 257/498] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:19.215803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.272952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32020a3-570a-4be4-a6ef-ba1b6b475ebe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.305256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.305918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.306191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.306459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.307285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:19.307586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.309040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.316889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde2cc-f5f2-47dc-b667-51877c5588fa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.343893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 242/499] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:19.344612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.350497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.351136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.351428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.351705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.352408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:19.352708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.354072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.365743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 258/500] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:19.366993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.436580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b6d5-f8ea-4290-8fc8-a83a1b8fc334 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.471911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.472703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.472969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.473237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.474371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de838607-e993-4553-82dc-a021c0bceff9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.485589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.487062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.507808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.508615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.508887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.509152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-a09b25fc-6671-4d5d-ac99-442c89c4dd38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:19.511604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:19.512595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:19.513421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:19.513421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:19.513421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:19.513421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:19.513421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 243/501] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:19.514031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557667c-fb1d-4dc0-8171-a8e939cc1b28 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.514307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557667c-fb1d-4dc0-8171-a8e939cc1b28 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.514661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557667c-fb1d-4dc0-8171-a8e939cc1b28 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.517042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 244/502] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:19.517042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557667c-fb1d-4dc0-8171-a8e939cc1b28 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.522211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:19.529804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:19.530729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:19.531524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 259/503] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:19.532431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.621437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557667c-fb1d-4dc0-8171-a8e939cc1b28 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.625876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d3ab-152b-45ec-8116-f355334a7ece None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.654051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.654674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.654941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.655207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.658330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.659117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.659398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.659671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.667260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.668764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:19.683806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:19.684738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 260/504] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:19.685670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.717830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.719280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb72d-90ac-4a89-8549-14491150f8b0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.789574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8a50-5613-446a-ab95-a91ec4bd4ee0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.823028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.823698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.824023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.824295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.824984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:19.825282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.826640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.826756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 245/505] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:19.828089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.828433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.828767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.838193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 261/506] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:19.839053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.844484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:19.845664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:19.911180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 246/507] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:19.912110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:19.931659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a2d5-2258-4ccd-82da-a4be05c1a748 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:19.964546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:19.965208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:19.965491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:19.965763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:19.966505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:19.966807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:19.968208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:19.975819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 262/508] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:19.976593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.001269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2974-8c47-479c-bd99-25613113be02 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.033935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.034617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.034889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.035208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.036055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:20.036351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.037780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.053899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 247/509] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:20.054514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.070875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814fdb0-6ad4-4d25-acaf-fded812e66c7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.103611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.104410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.104686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.104967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.117914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.119378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:20.136939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.137945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.138832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:20.138832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:20.138832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.138832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:20.138832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 263/510] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.139106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.148264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c62-daf2-4fd0-b033-187a89018722 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.179285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.180034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.180311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.180578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.187254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.188719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:20.202570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.203669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 248/511] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.205114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.246156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679581a0-3ddb-4083-b4d2-338cfa2f59cf None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.278526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.279318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.279598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.279910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.290450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.291999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.299948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ea83-62b9-458e-a634-edd98ae47fc5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:20.308285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.310059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:20.310059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:20.310059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.310059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:20.310059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 264/512] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.310329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.331897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.332742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.333025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.333296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.342860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.344350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:20.361118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.361950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.362788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:20.362788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:20.362788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.362788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:20.362788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 249/513] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.363064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.410316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb8a4-c9a3-4656-9a2a-9aebc382cc9c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.441986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.442570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.442879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.443160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.460172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf68d5-859e-4837-beb5-48d50fd6e5fb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.492401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.493040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.493316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.493588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.494298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:20.494698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.496083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.507332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 250/514] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:20.507957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.512583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.514073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.604557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b750aa-adb9-44d2-a2f2-a36ec6839114 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.612339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 265/515] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:20.613176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.637121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.637784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.638032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.638299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.639153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:20.639469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.640958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.657496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 251/516] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:20.658266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.715819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd454e-3eb8-41cc-8e1c-40f43020993a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.749595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.749772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538133-ec60-45a2-8004-c82023ecaf21 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.750409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.750753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.751028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.751755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:20.752088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.753467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.764879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 266/517] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:20.765670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.782507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.783169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.783446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.783714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.784464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:20.784763 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.786182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.796792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 252/518] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:20.797554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.858712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd56076-933b-4df8-a9bd-ad7226500d4e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.892267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fbe0-bd4f-4ebb-8af9-8a16c7c25519 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:20.892720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.893049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.893330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.893600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.900741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.902189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:20.917647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.918669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:20.919709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 267/519] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.920301 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:20.927220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:20.928046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:20.928323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:20.928591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:20.939614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:20.941097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:20.957793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:20.958867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:20.959736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:20.959736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:20.959736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:20.959736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:20.959736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 253/520] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:20.960052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.016206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598f116-b3af-4ee7-a749-845909a8f6a1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.048722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.049402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.049801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.050081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.053491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab305-55e0-4706-ae7e-ab0f0201d8e2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.084822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.085472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.085747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.086015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.086702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.088176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.109240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 254/521] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:20 2022] POST /identity/v3/users => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:21.110160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.115069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.116609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.216668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d487-1b54-49c0-854a-8a3986a0627b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.226909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 268/522] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:21.226909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.251445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.252510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.252794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.253061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.261256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.262732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:21.277633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:21.278578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:21.279463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 255/523] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:21.280090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.323818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998717b-653e-4376-a55a-23f34477bd0d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.356571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.357224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.357500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.357767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.358535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.358839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.360383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.377942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 269/524] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.378931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.379946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27eeff-bb7c-4721-9e30-a712fcae7a67 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.412671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.413333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.413617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.413887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.414622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.414899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.416311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.427943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 256/525] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.428762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.472529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33d4d-533c-42a0-bb35-aa89f55d1854 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.504893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.505685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.505984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.506229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.515827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.517280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.524288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f22ac-d223-4a26-92ed-19dcade4cf5f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:21.534259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:21.535231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:21.536505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:21.536505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:21.536505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:21.536505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:21.536505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 270/526] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:21.536800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.561561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.562240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.562530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.562781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.563615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.563945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.565392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.588238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 257/527] 10.222.0.11 () {56 vars in 1139 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.588238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.634056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef792b0-2c5d-4b32-9477-66f074dab10b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.665773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.666516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.666856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.667186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.668092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.668394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.669831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.675069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 271/528] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.675917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.679273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24bd7f-6cdc-4d24-87c8-143a83c6b8fd None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.716197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.717397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.717875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.718367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.726057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.727900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:21.743548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:21.744512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:21.745345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:21.752214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 258/529] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:21.753476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.777940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f6b9-1ae4-4723-abec-cf02f09740a1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.813154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.813743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.814018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.814286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.814996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.815293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.816775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.833264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 272/530] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.833264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:21.864033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f3a4-4cf0-4967-a199-980024218a7b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.897343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.897968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.898272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.898542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.935036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaacd2-0379-4cb8-b803-6409cccd67ac None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:21.964787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.966245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.968120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:21.968871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:21.969221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:21.969562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:21.970409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:21.970775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:21.972310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:21.984887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 273/531] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:21.985824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.062136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 259/532] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:22.062987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.082452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3aeeb-617d-426b-83ad-7bc5e6afb9f7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.117166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.118222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.118848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.119191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.128088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.130407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:22.147450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:22.148530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:22.149604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 274/533] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:22.150314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.159988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1598-43e9-4bad-9ec0-2265b1bd546c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.195800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.195800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.195800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.195800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.196241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=1d44d26a512a4a92806e60f3cb10dd33) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:22.196241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.196905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.204926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 260/534] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/role_assignments?user.id=1d44d26a512a4a92806e60f3cb10dd33&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:22.205110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.283403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7183761-9958-4957-bb8d-d6b83758962e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.358377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc4f90-356f-4b80-907d-ae42d81cc636 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.361502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.362324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.362717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.363001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.385333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.388186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.418880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.419556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.419856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.420137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.420934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:22.421242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.422834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:22.425267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:22.427243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:22.429322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:22.429322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:22.429322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:22.429322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:22.429322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 275/535] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:22.434570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.454727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 261/536] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:22.460921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.563422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1945-f938-4277-9d98-c9827d6fae78 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.589966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb3331-a8c8-48e3-a34b-4d8221410d26 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.604721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.605387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.605671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.605941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.606773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=45dbe9ca0c3f4d37906a4a42c6e45545) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:22.607082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.608615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.622553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 262/537] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/role_assignments?user.id=45dbe9ca0c3f4d37906a4a42c6e45545&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:22.650639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.651329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.651610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.651912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.652649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:22.652953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.654367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.672392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 276/538] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:22.677843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.794398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea62f7-e9a3-44ba-824d-e61f79f5fdec None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:22.835393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:22.836245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:22.836529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:22.836804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:22.844448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:22.845914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:22.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:22.868177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:22.869036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:22.872315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 263/539] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:22.877657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:22.977231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a736a-dcf3-4833-954d-6a2833364ad6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:23.018904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:23.020089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:23.020568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:23.021058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:23.022040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:23.022543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:23.024227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012af9-5179-4ff2-8763-ff4eac7bda02 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:23.040932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 277/540] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:23.046802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:23.173085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423abf5d-9cc6-4709-9d29-edec0ee40963 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:23.229340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:23.230011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:23.230291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:23.230561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:23.231391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=91edd760fda54f15913465f5497ccfcc) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:23.231699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:23.233162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098d4d6-0556-459f-93f8-0912b98fbfc6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:23.239968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 264/541] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:23 2022] GET /identity/v3/role_assignments?user.id=91edd760fda54f15913465f5497ccfcc&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:23.530069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5243-a757-410f-b76e-39ea8b95bf64 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:23.530292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5243-a757-410f-b76e-39ea8b95bf64 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:23.530602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5243-a757-410f-b76e-39ea8b95bf64 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:23.532184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 278/542] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:23.537519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:23.537812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:23.538089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:23.559734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:23.560941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:23.636981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 265/543] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:23.669650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5243-a757-410f-b76e-39ea8b95bf64 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:23.780982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5243-a757-410f-b76e-39ea8b95bf64 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:23.813041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:23.813839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:23.814119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:23.814393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:23.824438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:23.832094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:23.832993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:23.833778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 279/544] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:23.844885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:23.962537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3943-6b7a-45a4-a1b4-8042f94d674d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:24.009361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:24.010046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.010326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.010601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.011349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:24.011652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:24.013080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:24.023793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 266/545] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:24.029480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:24.155193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6179-1d61-42a3-8459-cb726e79c0a1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:24.195160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:24.196364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.196859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.197326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.219365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:24.221098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:24.238183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:24.239029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:24.239895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:24.239895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:24.239895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:24.239895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:24.242348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 280/546] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:24.248855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:24.414329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9728b-3d96-4c20-90bd-cd0355fe1e8d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:24.453390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:24.454058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.454339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.454613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.455334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:24.455637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:24.457076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:24.474614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 267/547] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:24.479917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:24.596855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a334-7501-419b-a965-333b8bfa39c2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:24.639317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:24.640145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.640427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.640703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.649661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:24.651128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-892cecae-c331-4a09-a6c9-75954a717356 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:24.670046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:24.670960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:24.671859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 281/548] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:24.678602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:24.809147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4ebb4-65ff-442f-9098-098941ab18b2 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.809475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4ebb4-65ff-442f-9098-098941ab18b2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.809707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4ebb4-65ff-442f-9098-098941ab18b2 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.811354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 282/549] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:24.816518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.816783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.817064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.833713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:24.834908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:24.858162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a558f6-7864-4db8-a4ae-d79403f393ad None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:24.907876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 283/550] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:24.913807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:24.914493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:24.914773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:24.915043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:24.915910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:24.916216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:24.917657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:24.925783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:24.950169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 268/551] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:24.955756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.023359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7923bd8-306d-4126-9eb6-9f9a6b438970 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.057016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.057823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.058107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.058380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.061089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264159-ebe8-4396-bb29-da403412c672 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.068927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1824d745-167a-476d-961f-753779cfd6e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:25.076608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:25.078609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:25.080565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:25.086108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 284/552] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:25.086108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78257b-0db4-4249-aecc-6e4fa3f9de44 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.086108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78257b-0db4-4249-aecc-6e4fa3f9de44 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.086108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78257b-0db4-4249-aecc-6e4fa3f9de44 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.086666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 285/553] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:25.090732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78257b-0db4-4249-aecc-6e4fa3f9de44 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.100263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.101230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.101660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.102068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.186700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.188829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.209435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78257b-0db4-4249-aecc-6e4fa3f9de44 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.248680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.249341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.249619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.249894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.250799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:25.251110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.253145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfbfa0-a0fe-4825-880e-f6c2cbbf4098 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.267004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 286/554] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:25.267004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.267004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.267004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.284263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:25.285567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:25.318991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 269/555] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:40:25.320715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.361284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 287/556] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:25.361944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.430785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3f8c-d510-4ee8-b5a2-e75aa306a763 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.464969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50335508-eca8-4f5c-889a-ad131263e3eb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.470091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.471023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.471301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.471578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.482187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.484190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.499129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.499970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.500252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.500521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-71708763-b4ff-4195-a29c-5ca13aaf88bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:25.504196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:25.505043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:25.505900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:25.505900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:25.505900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:25.505900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:25.505900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 270/557] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:25.507088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8ac8-09cc-4689-b5b2-722c5b1e78b1 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.507381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8ac8-09cc-4689-b5b2-722c5b1e78b1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.507647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8ac8-09cc-4689-b5b2-722c5b1e78b1 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.509055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 271/558] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:25.509591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d8ac8-09cc-4689-b5b2-722c5b1e78b1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.519520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.521063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:25.538474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:25.539336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:25.540329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:25.540329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:25.540329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:25.540329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:25.540329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 288/559] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:25.541024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.615344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d8ac8-09cc-4689-b5b2-722c5b1e78b1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.637888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452030a7-d149-4a79-a1c4-c6852646ca44 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.647228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.648082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.648341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.648607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.658379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e72ab8c3-3dd1-4fd5-b204-a9a888995dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:25.666003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:25.666889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:25.667679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 272/560] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:25.668378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.668775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.668860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.676468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.677349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.677821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.678264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.679135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:25.679636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.681045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.685183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:25.686595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:25.697839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 289/561] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:25.698582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.755146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 273/562] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:25.756065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.815584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf19be-db85-40e0-aae5-ae4742a7ed32 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.847220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.847970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.848251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.848527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.849229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:25.849532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.850894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.862133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 290/563] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:25.862367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b470f4-6b72-4608-8b53-1b184945a63b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.862943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.898938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:25.899614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:25.899938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:25.900215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:25.900959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:25.901258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:25.902619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:25.910546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 274/564] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:25.911319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:25.967123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eed08-cacd-4f9a-ab45-24eeec3a1f57 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:25.999543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.000344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.000631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.000889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.003859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82c95-a38a-4e05-b61c-aa66f9b346e8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.007875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.009250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:26.023183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.024340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 291/565] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.025696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.039664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.040500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.040777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.041049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.051065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:26.058709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.059618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:26.060679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:26.062794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 275/566] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.062794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.121863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bb2-651b-4ba1-8bc2-d4a58f06504a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.155592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.156404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.156680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.156951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.157814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e3b-ea3b-42d4-ab42-55c64d3440ac None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.163528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.164992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ed240c44-9fbe-44cd-89cc-3edfbf241a4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:26.178390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.179284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:26.180422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 292/567] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.181136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58c9e-882e-4d72-8752-ca2558aec7bd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.181136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58c9e-882e-4d72-8752-ca2558aec7bd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.181279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58c9e-882e-4d72-8752-ca2558aec7bd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.182422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 293/568] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:26.184657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e58c9e-882e-4d72-8752-ca2558aec7bd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.189713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.190497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.190772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.191075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.201639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.203091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:26.220123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.221033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.221936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:26.221936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:26.221936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.221936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:26.221936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 276/569] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.222201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.282504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e58c9e-882e-4d72-8752-ca2558aec7bd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.314759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.315408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.315678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.315970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.316819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:26.316995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f7d-d582-44e1-b5a3-82afe1e021e0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.317088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.318536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.348540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.349188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.349460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.349729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.350457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:26.350751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.352130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c9d5f-3efb-4702-ac82-d213f2d60efc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.354503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 294/570] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:26.355096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.359811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 277/571] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:26.361013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.361293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.361542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.378454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:26.379643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:26.439747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 278/572] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:26.440569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.447912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29cb7b-9469-4820-9e2a-97646f7e4cf0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.480117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.480762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.481042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.481314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.482085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:26.482389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.483869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.495348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 295/573] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:26.496157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.540400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3d6c-775a-47e2-beff-ba746572cbe3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.572467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.573145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.573428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.573703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.574428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:26.574733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.576150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.587217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 279/574] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:26.588022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.592821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5e27-77d5-4e4e-a678-6af10ef8170a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.629262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.630053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.630327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.630651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.640903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.642343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:26.658913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.659976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.660906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:26.660906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:26.660906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.660906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:26.660906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 296/575] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.661352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.684489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49788-bffe-4afd-a61d-3d88235513f5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.717660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.718453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.718738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.719121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.729375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.730858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:26.747532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.748512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.749404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:26.749404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:26.749404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:26.749404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:26.749404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 280/576] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.749895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.756981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bf1ee-c9e5-4355-947c-bc50f30b9f03 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.788194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.788981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.789241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.789514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.799231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:26.808280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.809248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:26.810493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 297/577] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.811448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.868717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4235-ba7f-4ff8-b6d3-36a23fffc1f6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.903675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.904425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.904721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.904986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.905804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=fe4065401c1645baa29331521821162e) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:26.906109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.907166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b510ea-4778-4f67-ae71-3c85bcb155ff None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:26.907553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.912912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 281/578] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/role_assignments?user.id=fe4065401c1645baa29331521821162e&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:26.913681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:26.942983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:26.943819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:26.944102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:26.944376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:26.953082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:26.954552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:26.969733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:26.970763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 298/579] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:26.977082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.027270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459f29-ef0e-49e5-bb41-6c263f47b6a4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.062587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.063177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.063513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.063720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.064479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.064781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.066259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.074080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79baa-1dbf-4ac0-b300-971532cad2c1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.079158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 282/580] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.080314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.107653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.108362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.108640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.108914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.109624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.109924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.111350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.123690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 299/581] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.124598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.177651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dbf1-5341-4f70-8e10-464fda33cef9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.212860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.213540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.213822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.214095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.214906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.215205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.216648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.222659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835464-1994-4895-a2e7-84ab38a32414 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.224878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 283/582] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.225585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.260864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.261529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.261809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.262081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.262897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.263198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.264656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.284322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 300/583] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.285219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.324918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7046db-14d2-42df-83ee-7012f32ac2d4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.355814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.356606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.356882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.357149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.363561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.365046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:27.379029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:27.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:27.385856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:27.386306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d517-1b48-4ae8-9114-26ca34f5f6c1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.386383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 284/584] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:27.386383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.416931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.417728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.418015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.418273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.425105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.426573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:27.440465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:27.441530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 301/585] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:27.442484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.486095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97a2b-5dba-483c-a79c-c0c550fc4b97 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.519426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.520249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.520541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.520795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.530430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.531931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.536742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b294e-2be4-4959-a667-7d26efe26c61 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:27.548988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:27.549948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:27.550856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:27.550856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:27.550856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:27.550856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:27.550856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 285/586] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:27.551702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.573699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.574492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.574755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.575081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.585824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.587291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:27.604861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:27.605972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:27.607083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:27.607083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:27.607083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:27.607083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:27.610894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 302/587] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:27.611689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.650754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13962-e23e-48f8-b5a5-b7cf03488612 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.684114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.684773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.685215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.685401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.686165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.686976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.687987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.699868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 286/588] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.700694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.708499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7def-b0b4-4fed-83cf-8ff67a303762 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.742111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.742784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.743062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.743330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.744184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.744486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.745933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.762517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 303/589] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.763330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.804303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3eef-079f-4d64-85f9-e88d0e405482 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.836299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.836893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.837177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.837448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.838545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.838545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.839830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.851211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 287/590] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.856209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.867629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d65c-941d-4fee-9f4b-3cab16d271fb None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.900034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.900695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.900971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.901242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.901943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:27.902240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.903667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:27.918908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 304/591] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:27.918908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:27.949950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a564c-1d6d-4299-9b82-d82e34493e15 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:27.981652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:27.982540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:27.982822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:27.983088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:27.997598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=c491e8f0641945908a72a96a8e2927c5, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:27.999128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.013543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 288/592] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:27 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:28.014389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.014920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c74b-6f81-49e5-b8c5-b6580fa11da9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.060554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.061857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.062391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.062859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.075646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.077717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:28.097368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:28.098346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:28.099252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:28.099252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:28.099252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:28.099252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:28.101593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 305/593] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:28.102673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.120058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8528ad-2205-457e-952c-036113a47e6b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.155407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.156277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.156533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.156795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.165177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.166396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:28.181991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:28.183013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:28.184419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:28.188342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 289/594] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:28.189333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.221932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ff53-c313-4eae-880c-0d9048ec98be None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.258374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.259174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.259456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.259728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.268864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.270689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:28.291009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:28.291957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:28.292882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:28.295644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 306/595] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:28.296773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.297597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c246b-e2ce-4cb5-b66b-bb874cddd93a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.332294 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.333117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.333521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.333893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.334718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:28.335120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.336913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.354116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 290/596] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:28.354116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.414659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08720-9674-4e58-958f-f07ffaeb642f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.449678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.450549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.450902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.451281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.452264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:28.452669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.454197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.468880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e3b2-c9fe-4d29-bb93-0659a9f76ec9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.476290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 307/597] 10.222.0.11 () {56 vars in 1139 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:28.477444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.509815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.510836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.511251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.511655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.512752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:28.513932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.515527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.530619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 291/598] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:28.532165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.577264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63169b27-09f5-412c-b28e-3e83fab746b6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.612714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.613629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.614006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.614376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.621990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.623681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:28.638104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:28.639205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:28.640345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:28.646368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 308/599] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:28.646368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.657009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611a840-f5e0-48d2-9c45-7663cfaf1076 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.691130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.692177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.692463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.692737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.703221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.704758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:28.722481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:28.723397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:28.724306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:28.724306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:28.724306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:28.724306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:28.728302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 292/600] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:28.729170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.767528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a294b1d-9576-49c5-b40a-eec973c7919c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.810873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.812305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.812973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.813407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/1d44d26a512a4a92806e60f3cb10dd33/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.827106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b9c4f-4aa4-4e89-ab30-f0b171d2dc37 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:28.831842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=1d44d26a512a4a92806e60f3cb10dd33, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.833458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.851086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 309/601] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:28 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/1d44d26a512a4a92806e60f3cb10dd33/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:28.852543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.867155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:28.867726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:28.868126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:28.868517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:28.869501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:28.869903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:28.871582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:28.885020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 293/602] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:28.890944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:28.979116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904584e5-d01b-4ec5-b833-614e55f284fb None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.020403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.021821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.022301 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.023003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.024116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:29.024645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.026233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.031923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c952-f116-4308-89ee-6b881c5b0735 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.041181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 310/603] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:29.047088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.112495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.113484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.113764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.114037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/45dbe9ca0c3f4d37906a4a42c6e45545/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.132687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=45dbe9ca0c3f4d37906a4a42c6e45545, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc7718-e1a6-4465-8a21-d63a3649aa64 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.158954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 294/604] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:28 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/45dbe9ca0c3f4d37906a4a42c6e45545/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:29.169082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba6107-77bc-4830-8589-532bda7571bf None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.169363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba6107-77bc-4830-8589-532bda7571bf None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.169639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba6107-77bc-4830-8589-532bda7571bf None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.171059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 295/605] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:29.177090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.177373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.177648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.192935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d990-e7dc-4c4d-ba97-9dd5b4e76975 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.205001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:29.206285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:29.227671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.228545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.228774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.229047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.236480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.238072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:29.253190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:29.254228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:29.255386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 311/606] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:29.260381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.366079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 296/607] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:29.388849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.429930 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffb5dc-1844-44ec-b601-82a02db85023 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.472734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.473743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.474200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.474644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.475589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:29.476090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.477749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.491024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 312/608] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:29.496879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.511477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1995882-f861-4fe3-92d3-0688956d13eb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.554420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.555256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.555539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.555810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.566278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:29.574211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:29.575226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:29.576139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 297/609] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:29.581574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.601342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4919-8899-485a-91be-ad998b02ad22 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.635623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.636931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.637407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.637872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/91edd760fda54f15913465f5497ccfcc/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.653228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=91edd760fda54f15913465f5497ccfcc, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.654988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.671367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 313/610] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:29 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/91edd760fda54f15913465f5497ccfcc/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:29.699742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab014f-6a43-47db-ad4a-0c97cfdc8083 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.749477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.750295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.750577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.750844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.751596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:29.751926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.753315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.767989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 298/611] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:29.773772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:29.886618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d571b4f-1b19-4ff4-8fe6-301383b920a7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:29.925041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:29.925896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:29.926174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:29.926440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:29.944910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:29.946730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:29.971260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:29.972345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:29.973238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:29.973238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:29.973238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:29.973238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:29.975266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 314/612] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:29.981023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.099144 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f700c-391c-4ea8-b3c5-df6b2e29f2ff None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:30.149405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:30.150071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.150346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.150614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.151329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:30.151625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:30.153015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:30.168793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 299/613] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:30.174347 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.307262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339da7-276a-413e-b946-1bc8cbbf14db None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:30.341542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:30.342339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.342607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.342877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.350294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:30.351731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:30.366047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:30.367298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:30.368261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 315/614] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:30.373391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.525404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572ed28-aa47-4726-8638-76469cc85a91 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:30.568069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:30.568740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.569014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.569281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.570112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:30.570409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:30.571852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39416-7d16-43b5-996e-d90a1599c6f8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:30.595621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 300/615] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:30.602452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.680679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b14f3-1bd6-4d14-b5c3-0afa86c7ed72 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.681007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b14f3-1bd6-4d14-b5c3-0afa86c7ed72 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.681215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b14f3-1bd6-4d14-b5c3-0afa86c7ed72 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.682823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 301/616] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:30.688207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.689253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.689253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.720861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:30.722073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c35c-4141-41f8-bb55-a20e5d1d39a4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:30.722254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:30.759618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:30.760444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.760715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.760983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.772179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:30.773599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:30.791960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:30.793891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:30.795470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:30.795470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:30.795470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:30.795470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:30.795470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 316/617] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:30.799451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.868284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 302/618] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:30.893282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:30.935697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49761-7233-4600-8425-fd76a8b1b47f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:30.994437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:30.995440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:30.995928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:30.996385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:30.997278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:30.997769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:30.999316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.017807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 317/619] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:31.022858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.035985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab9cb-ef0c-47d1-acd5-e35da99f89ca None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.068859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.069587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.069862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.070127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.080247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:31.087952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:31.088945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:31.089831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 303/620] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:31.098961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.204252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fabf6c-46f4-4f71-bd01-556716c6bd5f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.252132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03911f1-89cb-4d4a-86e1-568abeb7623d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.286771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.287443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.287724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.287946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.288059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.288760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:31.289057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.289470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.289946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.290411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.290518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.298945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 304/621] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:31.304242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.312967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.315058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:31.335977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:31.336898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:31.337799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:31.345662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 318/622] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:31.351176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.400834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9b96-efa3-4aee-90a9-7c77afdc9b65 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.435795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.436603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.436876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.437147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.454982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.456531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:31.489866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:31.490861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:31.492102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:31.492102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:31.492102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:31.492102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:31.499975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 305/623] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:31.508721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.525265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770f5c-d044-4243-bed7-7e94a509ba36 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.586374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.586960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.587236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.587506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.588329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:31.588636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.590080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.608906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1257e4d-b81b-47d5-a3aa-0441b746e826 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.610472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 319/624] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:31.615952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.649481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.650148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.650426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.650696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.651415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:31.651749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.653107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.678979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 306/625] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:31.697178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.754288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4100c2-5d25-4237-9332-100f73f87868 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.798025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.798926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.799202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.799473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/fe4065401c1645baa29331521821162e/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.802359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce615-f30f-42cf-8f2b-bc72d495e747 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:31.815892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=fe4065401c1645baa29331521821162e, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.818163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5026-fde2-4179-ace4-79eaef894058 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.835446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 320/626] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:31 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/fe4065401c1645baa29331521821162e/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:40:31.836877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b8da-77b4-44e5-8997-3b3c219b5027 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.837109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b8da-77b4-44e5-8997-3b3c219b5027 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.837384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b8da-77b4-44e5-8997-3b3c219b5027 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.838835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 321/627] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:31.844292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.844582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:31.844768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.844941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.845292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:31.845575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:31.845840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:31.859830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:31.861413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:31.863864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:31.865076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:31.886631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:31.888906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:31.891186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:31.895624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 307/628] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:31.900274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:31.943168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 322/629] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:31.969027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.041786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d768-fa1f-4a5e-86d6-b2bded153a09 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.076731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.077382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.077659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.077929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.078761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:32.079064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.080601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77168c-157f-4573-92ad-47dbe2f48777 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.099116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa55c-3d99-40a9-a307-043011dab5dd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.104830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 308/630] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:32.106157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931415a3-2307-4b4e-855f-61fb5fbc6afb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.106912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931415a3-2307-4b4e-855f-61fb5fbc6afb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.107198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931415a3-2307-4b4e-855f-61fb5fbc6afb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.109153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 309/631] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:32.110216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931415a3-2307-4b4e-855f-61fb5fbc6afb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.138401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.139197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.139476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.139748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.152690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c60d55cd-a248-41cf-a180-f8d7897177cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:32.160428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:32.161418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:32.162994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 323/632] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:32.163754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.163754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.163754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.184648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:32.185821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:32.236000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931415a3-2307-4b4e-855f-61fb5fbc6afb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.254384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 324/633] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:32.255241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.278080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.279230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.279857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.280280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.351953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.353669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.357840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d513d4-b6d7-4bad-ae3c-77bea3011df4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.395096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.396378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.397118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.397556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.398629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:32.399524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.401631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.413358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 325/634] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:32.414935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.461834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 310/635] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:32.463071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.522165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d426d-d206-489c-a26b-e08932fa1ba6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.554717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d115d-8234-40ef-9354-73846231b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.555660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d115d-8234-40ef-9354-73846231b930 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.556075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d115d-8234-40ef-9354-73846231b930 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.556466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d115d-8234-40ef-9354-73846231b930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.560237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db54b-affc-4a80-909f-470358aa4530 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.566946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d115d-8234-40ef-9354-73846231b930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-527d115d-8234-40ef-9354-73846231b930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:32.574910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:32.576105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:32.577133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:32.578335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 326/636] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:32.583924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d115d-8234-40ef-9354-73846231b930 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.599098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.600300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.600778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.601250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.611561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.613042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:32.633589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:32.634570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 311/637] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:32.636254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.688257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d115d-8234-40ef-9354-73846231b930 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.723032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.724317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.724740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.725018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.731411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbad56c-4a1f-4cda-a5aa-3f96c29b32ca None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.739291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.739482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ae2115de-8c69-4966-a9f6-0b9d51c9b07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:32.756842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:32.757935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:32.758823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:32.758823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:32.758823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:32.758823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:32.758823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 327/638] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:32.759419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff3f6-dfa4-4b85-b226-a386e900cc8d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.759595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff3f6-dfa4-4b85-b226-a386e900cc8d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.759877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff3f6-dfa4-4b85-b226-a386e900cc8d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.761273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 328/639] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:32.761866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ff3f6-dfa4-4b85-b226-a386e900cc8d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.773672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.774346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.774616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.774879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:32.775943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.777294 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.789692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 312/640] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:32.789692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.872480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ff3f6-dfa4-4b85-b226-a386e900cc8d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.881776 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8065f1-1102-46e5-a0cd-9aaf392095b4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:32.905128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.905792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.906068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.906339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.907074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:32.907462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.908770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d406d8-659c-456b-8c77-3b27e2b64ddb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.914061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:32.914723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.915001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.915628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.916011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:32.916316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:32.917673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:32.924651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 329/641] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:32.924651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:32.924651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:32.924651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:32.936031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 313/642] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:32.936031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:32.939595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:32.940823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:33.011447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 330/643] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:33.011447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.043402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd2074-d6f4-483e-91d2-c040b7ddcfcb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.077969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.078768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.079041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.079313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.090309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.092218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.102838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25146685-e80c-461b-ab0b-8a145eebffd8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:33.113469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:33.114473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:33.115366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:33.115366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:33.115366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:33.115366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:33.119954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 314/644] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:33.120555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.138145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.138882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.139158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.139423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.146473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.147954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:33.161893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:33.162863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:33.163915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 331/645] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:33.164534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.225123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a577c-0eda-4a6c-a3f4-19bf2e139025 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.257934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.258982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.259338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.259585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.261527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050328-a70d-49b0-9769-1740f805be9a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.266184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.267626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:33.281028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:33.281935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:33.282847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 315/646] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:33.284078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.299837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.300670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.300948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.301218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.311324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:33.318875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:33.319840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 332/647] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:33.325520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.376095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2173e-52a7-407f-a0a7-53c2dbec2db4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.408276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.408922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.409220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.409555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.410269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:33.410565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.411946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.420492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b36971-c5c3-4044-8966-88ec7bac962e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.428495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 316/648] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:33.428495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.454231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.454939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.455177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.455456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.456359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:33.456654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.458099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.479172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 333/649] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:33.479172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.525435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32a65-a1d0-4b11-87fb-671e685e3daa None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.557852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.558510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.558775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.559040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.559856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:33.560166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.561590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.570546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313d14-c3ba-4ea2-bf65-7228a8551d39 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.572947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 317/650] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:33.575823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.603801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.604490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.604770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.605112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.605815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:33.606129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.607470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.620333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 334/651] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:33.620333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.675953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b784-9b36-4815-b425-6d0ad2655383 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.708287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.709083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.709356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.709623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.711011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a803d7a-32b0-42fa-a3a8-0b3b2e9f80a5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.716945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.718365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:33.732137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:33.733117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 318/652] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:33.734098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.748300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.748963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.749243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.749517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.817089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.818539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.833212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b3797-0b9e-4f4d-bae5-10dc1c8403ee None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:33.865708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:33.866710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:33.866943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:33.867221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:33.868088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:33.868396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:33.869822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:33.884078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 319/653] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:33.884078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:33.921623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 335/654] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:33.922610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.029585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37ec4-3de5-4cd9-870c-830634dbc4e0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.052075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558fd18-1a4d-4763-be61-583b93072e36 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.071230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.072421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.072704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.073045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.088458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.090393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.095580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.096380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.096747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.097169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.098081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:34.098453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.100006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:34.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.112759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.113656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:34.113656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:34.113656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.113656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:34.116246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 320/655] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.117115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.122280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 336/656] 10.222.0.11 () {56 vars in 1137 bytes} [Tue May 3 08:40:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:34.122528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.221603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90d75-7a7d-43bf-9290-ab4a91d7fa36 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.228497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f00d-da5c-4990-889b-11f6c841fe01 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.254607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.255407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.255689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.255986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.261045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.261708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.261990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.262271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.262986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:34.263290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.264736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.266389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.267842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.275881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 337/657] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:34.280553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0bbba859-2ee7-4b61-a34a-1d8d5836d3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:34.284550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.285423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.286411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:34.286411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:34.286411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.286411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:34.286411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 321/658] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.289240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762e37-9565-4118-b7dd-958ec92da937 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.289240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762e37-9565-4118-b7dd-958ec92da937 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.289240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762e37-9565-4118-b7dd-958ec92da937 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.289240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 322/659] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:34.293464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762e37-9565-4118-b7dd-958ec92da937 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.379957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51d4-d3e4-457f-b673-8797a6e1ea57 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.394475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762e37-9565-4118-b7dd-958ec92da937 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.411805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.412452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.412733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.413006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.426717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.427517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.427785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.428090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.435908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.437716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:34.452274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.453220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:40:34.454172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:34.455388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 323/660] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.455388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.478599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.480129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61628b-163b-4f42-a039-704465ca7bbd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.557702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27bdf-cbae-47c3-95a7-1d1bc1ad348a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.573762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 338/661] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:34.575392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.575684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.575990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.592292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:34.593556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:34.595392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.596107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.596386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.596660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.597407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:34.597709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.599105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.615229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 324/662] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:34.615229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.667797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 339/663] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:34.667797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.721163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c9524-814b-4c69-9c17-a5a491fb37a5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.754633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.755316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.755593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.755892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.756714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:34.757010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.758452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.765779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc743601-6173-4e18-ba03-57dbf05ed071 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.779606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 325/664] 10.222.0.11 () {56 vars in 1139 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:34.779606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.798310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.799098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.799378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.799647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.809601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.810994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:34.827994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.828921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.829808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:34.829808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:34.829808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:34.829808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:34.831934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 340/665] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.832770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.880467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41080c67-ddb5-4aac-89b6-e04e056fb80a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.913031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.913858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.914099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.914403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.920970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:34.922394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:34.933504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21a6b-ad04-4c4b-8138-46346bd25bd6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:34.937220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.938114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:34.938996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:34.943206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 326/666] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.944011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:34.969568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:34.970352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:34.970629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:34.970883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:34.980500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:34.988085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:34.989175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 341/667] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:34.992764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.054869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad7d93-b528-4df6-ab12-185c7712e6e6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.086917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df297-5c50-480c-b117-66473db3ea3e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.087903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.088564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.088842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.089119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.122116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.123110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.123383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.123653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.124392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.124690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.126061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.141783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 342/668] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.141783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.158145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.159628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.237481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0360d67-8271-442c-ba6d-120f01bc2497 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.263704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 327/669] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:35.263704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.272076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.272737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.273018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.273292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.274065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.274365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.275797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.291596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 343/670] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.291596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.350885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bfc2-8cf7-46cf-8689-4e74cf63d7ea None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.382173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.382469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a907-f8a1-490a-a9df-d70194e53d7f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.382840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.383115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.383383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.384145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.384448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.385814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.398147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 328/671] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.398147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.414524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.415313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.415588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.415946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.422390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.423844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:35.437694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:35.438604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 344/672] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:35.444744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.490287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6b00-c475-4eff-9192-b4d95d98ae63 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.523502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.524334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.524608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.524873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.535019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.536476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.536764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe283-705a-44de-bfbe-374aa578767b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:35.556308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:35.557423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:35.558536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:35.558536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:35.558536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:35.558536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:35.560105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 329/673] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:35.561019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.570607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.571262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.571545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.571846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.572678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=1d44d26a512a4a92806e60f3cb10dd33) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.572989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.574427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.580201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 345/674] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/role_assignments?user.id=1d44d26a512a4a92806e60f3cb10dd33&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.580983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.682903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270bf3d-fc8d-45ed-ae68-e9cad5d25552 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.692621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c5a7-185c-4b05-9656-0493fc51702b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.726318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.727122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.727446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.727651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.728750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.729476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.729823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.730163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.731020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.731391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.732939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.739333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.740813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.745908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 346/675] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.746852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:35.761327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:35.762493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 330/676] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:35.763938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.848598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e642693-2a62-4529-bf3b-c760e48d76c6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.864435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db9cb-d089-447a-ac51-d7fdbd322fe0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:35.882132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.882800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.883084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.883359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.884104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.884409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.885774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.898002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 347/677] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.898853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:35.904258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:35.904917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:35.905246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:35.905522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:35.906352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=45dbe9ca0c3f4d37906a4a42c6e45545) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:35.906656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:35.908107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:35.914845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 331/678] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/role_assignments?user.id=45dbe9ca0c3f4d37906a4a42c6e45545&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:35.915793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.044954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5bb3-85be-40ce-900e-37892e3e691e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.087437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f622c-668a-4ffd-a577-b9650c99ee64 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.119581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.120390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.120672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.120945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.121662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:36.121964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.123337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.124545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.125342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.125617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.125883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.133379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.134914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:36.151573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:36.152593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:36.153489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 332/679] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:36.157933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 348/680] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:36.159209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.164364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.270579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93285101-3cf2-4221-875d-8e9e9f2da7fe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.292140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d90e-0dab-49f6-b523-0e8b876ba762 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.305948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.306546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.306827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.307100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.307935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:36.308242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.309689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.321615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 333/681] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:36.327441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.332986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.333791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.334073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.334349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.344488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.346463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:36.364377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:36.365362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:36.366772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 349/682] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:36.371736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.437518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b13dc-1a51-4bde-af6e-fdcaceb59f5a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.470823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544413-0f4f-485f-a2aa-28f23cbe29c4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.474087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.474980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.475426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.475887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.476893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=91edd760fda54f15913465f5497ccfcc) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:36.477372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.478996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfc40-c429-472a-be0e-b5cca9f109e2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.491907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 334/683] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/role_assignments?user.id=91edd760fda54f15913465f5497ccfcc&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:36.493721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf1e5-fb8c-4284-96ff-65eda1b36a37 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.494174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf1e5-fb8c-4284-96ff-65eda1b36a37 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.494611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf1e5-fb8c-4284-96ff-65eda1b36a37 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.496503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 335/684] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:36.501760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.502355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.502816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.507405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.508111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.508392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.508660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.514184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:36.514184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.514184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.534590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 350/685] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:36.536057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:36.537403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:36.539979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.654604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 336/686] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:36.677081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:36.744568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d80c9-b6d7-4ec0-a719-25e5e1e6bdbd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.783118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.783908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.784281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.784635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.810400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcd91a-6e0a-44c0-9afe-1d36c330b278 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:36.844593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:36.845396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:36.845733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:36.846006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:36.856732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:36.865409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:36.866681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:36.867515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:36.868199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:36.868280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 337/687] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:36.868849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:36.872684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.003843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 351/688] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:37.011257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.031555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76949-5958-4373-b56d-a6fb0c06ba4f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.092006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.092679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.092953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.093223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.093965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:37.094265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.095634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.111726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 338/689] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:37.133402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.171583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5d3b-ecfd-41a8-86f7-df8ae1f396d1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.253144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.253993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.254213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.254485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.270909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.274241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:37.300354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:37.302410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:37.304476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:37.304476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:37.304476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:37.304476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:37.304476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 352/690] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:37.307186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.342505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71675f-8f6d-4409-9aa9-926ace2aaecb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.375376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.376205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.376478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.376747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.387253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.388719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.403556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8bf0-dea9-4800-b71e-8af811c1920a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:37.405422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:37.406298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:37.407186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:37.407186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:37.407186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:37.407186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:37.407186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 339/691] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:37.421367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.441975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.442636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.442916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.443188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.443977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:37.444281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.445681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.457581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 353/692] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:37.463029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.563820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d64d8-ec11-4dcf-8039-7bef746a4b96 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.596445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.597276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.597552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.597822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.604729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.606343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:37.620887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:37.622894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:37.624997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 354/693] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:37.631797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.632047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7f5b-a864-42e4-abfb-12f1f38792c9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.708473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.709543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.710035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.710491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.711408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:37.711932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.713489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.738025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 340/694] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:37.743380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.750198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435a6f6-4461-4a47-9696-3eb1fe044cdc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.792192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.792850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.793126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.793393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.794221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:37.794519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.796980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.826378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 355/695] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:37.831868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:37.876102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263374-3ff5-4432-8cf0-163cdc3786d7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:37.914148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:37.914950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:37.915228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:37.915498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:37.931678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:37.933203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:37.964472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:37.965812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:37.967165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:37.968013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 341/696] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:37.971866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.038622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a323-de07-4efb-b928-1f334cbdcdfa None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.107012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.107590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.107890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.108161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.108983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=fe4065401c1645baa29331521821162e) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:38.109291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.110715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e110b5d-7866-49f7-9623-67ee0825b1ab None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.121327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 356/697] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/role_assignments?user.id=fe4065401c1645baa29331521821162e&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:38.139007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a914-4177-445c-b58c-60df5c8a3f9d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.139338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a914-4177-445c-b58c-60df5c8a3f9d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.139545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a914-4177-445c-b58c-60df5c8a3f9d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.141919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 357/698] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:38.147008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.147292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.147568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.148093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0b4f-1abf-4dab-b5af-3e9b2bbea6a1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.184085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.184814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:38.185393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.185857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.186067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:38.186520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.187598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:38.188150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.189801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.209094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 342/699] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:38.215212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.324800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1db017-5785-4385-9cfc-6aa3485671a0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.359755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.360784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.361273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.361748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.362572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 358/700] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:38.396333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.433310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.435090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.528167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4fb38-77d8-4343-b6c6-97e88e11b603 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.539631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 343/701] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:40:38.545211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.569669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.570492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.570768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.571035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.571686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.573583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:38.591545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:38.592647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:38.593498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 359/702] 10.222.0.11 () {56 vars in 1129 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:38.599648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.661268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d35c-64af-40ea-8db4-e6f34201684c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.710721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.711464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.711741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.712106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.725486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.727240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.730507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c54c5-a80e-48a7-95ff-e23218edcc3f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:38.751322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:38.752311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:38.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:38.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:38.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:38.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:38.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 344/703] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:38.760305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.778526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.779643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.780142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.780891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.781765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:38.782284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.784438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.791116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 360/704] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:38.797371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.864250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12d0b-d209-4582-b321-eccafc8a8fc3 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.898812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.899515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.899740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.900054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.900770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:38.901069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.901856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9482b0-536b-4deb-8d5b-1662ad7fda68 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:38.902427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f696335-70ce-4114-85fc-db99301e84da None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.921029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 345/705] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:38.921029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553206a-6f18-40ae-a308-60d64683b6c7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.921029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553206a-6f18-40ae-a308-60d64683b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.921029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553206a-6f18-40ae-a308-60d64683b6c7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.921029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 346/706] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:38.922038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553206a-6f18-40ae-a308-60d64683b6c7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:38.941427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:38.942397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.942846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.943333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.944233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:38.944724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:38.946260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ac5b-5dd2-4838-bdbb-63d0c04e8666 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:38.952407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 361/707] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:38.953980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:38.954469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:38.955216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:38.988539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:38.992172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:39.111589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 362/708] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:39.116807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553206a-6f18-40ae-a308-60d64683b6c7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.136041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.167817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.168730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.169019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.169292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.176472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.177926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:39.194107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:39.195240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:39.196443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 347/709] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:39.201239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.254853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1f6d-fe43-48c7-ac2c-d71d9c9c0c71 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.288660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.289833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.290302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.290758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.300200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28559d-19e4-4a49-807b-ff1e125e6e5d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.302221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.303946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-3fb145fc-83bb-4003-990e-7903f8a11247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:39.321394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:39.322375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:39.323265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:39.323265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:39.323265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:39.323265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:39.325522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 363/710] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:39.331507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63403d-610e-47bb-851c-fb1a4a1c1e15 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.332111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63403d-610e-47bb-851c-fb1a4a1c1e15 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.332535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63403d-610e-47bb-851c-fb1a4a1c1e15 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.334398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 364/711] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:39.335296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63403d-610e-47bb-851c-fb1a4a1c1e15 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.339297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.340006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.340288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.340565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.341356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:39.341663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.343106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998b7e7-e091-45ef-9250-b1f36e4e3f8b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.355570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 348/712] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:39.361254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.361543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.361808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.378358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:39.379565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:39.450179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 349/713] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:39.451308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.458002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63403d-610e-47bb-851c-fb1a4a1c1e15 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.501092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.501751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.502023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.502698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.503500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:39.503841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.505871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.523863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 365/714] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:39.524815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.571921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace04d-2336-4c3d-88c5-3e51a7289096 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.610626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.611277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.611552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.611854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.612734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:39.613037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.614458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.621686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 350/715] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:39.622676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.644886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d943d3-999a-4404-83b2-05d3b9b050b0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.688005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.689480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.689962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.690632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] PATH_INFO: `/v3/services/network` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.691978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.693997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:39.709529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:39.710565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:39.711403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:39.715848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 366/716] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:39.723936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:39.781364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5384-7f30-406d-94e1-080aa1a36204 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.878504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.878794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.879104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.879352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.880932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.881657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.898074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fb15-e545-45e8-ab11-53edba792fdb None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:39.913637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 351/717] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:40:39 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:39.933922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:39.934569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:39.934852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:39.935127 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:39.935867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] RBAC: Adding query filter params (name=network) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:39.936175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:39.937589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b025-466c-4ee6-b9d1-4c51461f6ba7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:39.943154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 367/718] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:39.948876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:40.104586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0cdc3-33a4-4b84-b658-2eb41d56ff3c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:40.153977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:40.154719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:40.155000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:40.155272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:40.156058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] RBAC: Adding query filter params (type=network) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:40.156361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:40.157733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9702-72a1-43bc-8060-3575a3c0217d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:40.169140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 352/719] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:41.271679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a9c9-a9a6-4b7e-9abf-15cb281dd3d7 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.271679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a9c9-a9a6-4b7e-9abf-15cb281dd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.271679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a9c9-a9a6-4b7e-9abf-15cb281dd3d7 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.272813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 368/720] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:41.278374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b077b-c82d-482f-85b3-b3e4b6f0e6e4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.279205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b077b-c82d-482f-85b3-b3e4b6f0e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.279706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b077b-c82d-482f-85b3-b3e4b6f0e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.297159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a83b077b-c82d-482f-85b3-b3e4b6f0e6e4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:41.298704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a83b077b-c82d-482f-85b3-b3e4b6f0e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:41.375871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 353/721] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:41.393907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476a9c9-a9a6-4b7e-9abf-15cb281dd3d7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:41.516271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476a9c9-a9a6-4b7e-9abf-15cb281dd3d7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:41.555792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c37-e9bd-4f2d-9dd8-bb7bc02187bb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.556120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c37-e9bd-4f2d-9dd8-bb7bc02187bb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.556361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c37-e9bd-4f2d-9dd8-bb7bc02187bb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.557955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 354/722] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:41.562851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.563173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.563395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.564026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:41.565045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.565608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.566105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.587621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:41.588851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:41.591732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:41.599439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:41.600419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:41.601303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:41.602207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 369/723] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:41.610889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:41.708189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 355/724] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:41.750480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:41.781032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc77628-f4e7-4c7e-9637-dcae496d4e31 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:41.868549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:41.869240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.869517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.869798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.870366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85689a50-fa7a-4675-a2b7-b8ed9f1d0907 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:41.870553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:41.870844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:41.872333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:41.894403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 370/725] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:41.908026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:41.915921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:41.916965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:41.917525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:41.924003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:41.925216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:41.927006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd9a3-1f5a-44d4-aabf-2ae3fa36ed2b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:41.964157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 356/726] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:40:41 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:40:42.036693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c964d-db52-454c-88e5-0df019d137a2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.093173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.094001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.094282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.094557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.105518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.106975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-9ca7f123-3beb-4c0f-9867-c052a3defd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:42.130843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:42.131865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:42.133235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:42.133235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:42.133235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:42.133235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:42.133235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 371/727] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:42.136432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfae2-fac2-4310-bb2c-d51e4b3b1a53 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.137053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfae2-fac2-4310-bb2c-d51e4b3b1a53 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.137517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfae2-fac2-4310-bb2c-d51e4b3b1a53 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.143094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 357/728] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:42.144727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfae2-fac2-4310-bb2c-d51e4b3b1a53 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.145030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.145322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.145596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.180884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:42.182091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:42.254222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfae2-fac2-4310-bb2c-d51e4b3b1a53 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.294255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.296038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.296463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.297138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.298027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:42.298480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.300497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.307516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 372/729] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:40:42.315708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 358/730] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:42.320451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.333425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.431673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579cc06-7da5-4064-bd4e-c45f36d08a08 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.470025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.470921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.471262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.471673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.480023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.481565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:42.498086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:42.499101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:42.500086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:42.503867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 373/731] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:42.505471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.568701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038671a-e820-49f8-8c6e-324325ca8ae0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.618458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe84f0-440e-4492-8759-914550a30978 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.657242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.658182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.658596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.659059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.659202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.659532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.659745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.660009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.663805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:42.663805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.663805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.686290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 374/732] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:42.688212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:42.688863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:42.704514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:42.705753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:42.706963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:42.709445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 359/733] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:42.715352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:42.803795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb8f97-4d5e-44e7-b307-c3283b288724 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.835337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.835930 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.836208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.836481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.875899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555fa5-73f4-4e54-a661-04a861b38456 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:42.901207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.902649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.908508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:42.909208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.909484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.909753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.910485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:42.910782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:42.912160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b1fd7-9413-4e1a-8b9d-43599e1bdd47 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:42.920386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 360/734] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:42.921614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0da3-5f56-4866-aee2-2d2d79f5d6e7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.921900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0da3-5f56-4866-aee2-2d2d79f5d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.922172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0da3-5f56-4866-aee2-2d2d79f5d6e7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.927611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 361/735] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:42.928791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:42.929074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:42.929346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:42.945407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:42.946569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:43.002987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 375/736] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:40:43.008282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.018479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 362/737] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:40:43.019326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.102758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9474d-a0bb-4c47-bb34-dc2fd5cfbe5e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.131046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344d26-e67f-4516-8a62-648b11cb526e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.135498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.136319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.136594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.136864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.147063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.148583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.163634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.164467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.164740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.165002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:43.166696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:43.167733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:43.168708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:43.168708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:43.168708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:43.168708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:43.168708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 376/738] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:43.168996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.180316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.181765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-23a5e659-9fe7-4e5f-958d-3a6740c38ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:43.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:43.200056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:43.200964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:43.200964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:43.200964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:43.200964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:43.204784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 363/739] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:43.206110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b3ec-b4ea-4af3-b563-cc62b3401d83 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.206394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b3ec-b4ea-4af3-b563-cc62b3401d83 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.206663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b3ec-b4ea-4af3-b563-cc62b3401d83 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.211888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 364/740] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:43.211888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394b3ec-b4ea-4af3-b563-cc62b3401d83 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.271058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ac87-f5fb-4cb5-80ac-c5f87de4922d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.304878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6786-a816-4688-a976-651a853ea438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.305542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6786-a816-4688-a976-651a853ea438 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.305822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6786-a816-4688-a976-651a853ea438 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.306090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6786-a816-4688-a976-651a853ea438 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.306799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e6786-a816-4688-a976-651a853ea438 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.308212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e6786-a816-4688-a976-651a853ea438 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.309457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394b3ec-b4ea-4af3-b563-cc62b3401d83 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.331976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 377/741] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:40:43 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:43.333724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6786-a816-4688-a976-651a853ea438 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.351666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.352481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.352698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.352968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.353651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:43.353952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.355355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19ea4-f143-4fec-b958-4d9caab46961 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.373922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 365/742] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:43.375442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.375839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.376125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.394620 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:43.395870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:43.468498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6786-a816-4688-a976-651a853ea438 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.472269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 366/743] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:43.473242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.510816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.512119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.512598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.513083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.513991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:43.514484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.516040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.528649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 378/744] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:43.529509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.604768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccea6d-efc0-404c-8f7b-be8c6b966a1e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.636907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5a7e0-be7a-4f81-a03b-7da13f2bc652 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.652831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.653638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.653913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.654172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.665096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.667135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.681888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.682758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.683102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.683485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:43.687298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:43.688704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:43.689746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:43.692051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 367/745] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:43.693231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.698777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:43.706709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:43.707904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:43.708983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:43.715351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 379/746] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:43.716344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.804991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae767a-3536-43bf-b8fc-1690dab20421 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.824266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216afe9-5be3-42e2-a3de-9915d56d9d11 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.839673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.840621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.840991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.841349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.848043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.849568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:43.863060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:43.864219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:43.865389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:43.866361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:43.867196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:43.867604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:43.868040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:43.869013 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:43.869446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:43.871001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:43.871965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 368/747] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:43.872988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.892843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 380/748] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:43.893949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:43.976929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee746-6f91-4744-986b-d2f27f48b57a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:43.993097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae575e1-c44b-426f-8557-55a2bf695940 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.009960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.010653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.011008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.011234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.012041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.012343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.013716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.022450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 369/749] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:44.023291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.032813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.033483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.033760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.034097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.034876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.035176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.036645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.053447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 381/750] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:44.054334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.144775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f625-6c85-496e-84fb-ffed95192ca4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.161066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ff98-9f5d-4cc6-9ea0-59bbaec8c66a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.185579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.186925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.187258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.187534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.197100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.198013 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.198381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.198740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.199627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.202778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.211795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.211795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:44.222387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:44.223515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:44.224519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:44.224519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:44.224519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:44.224519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:44.228330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 370/751] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:44.229187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:44.231078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:44.231971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:44.232865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:44.232865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:44.232865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:44.232865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:44.237154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 382/752] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:44.238172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.337529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995bb8-0b62-4454-8b0d-9f4d91a4c063 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.352639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b6ea-be76-4e5e-8222-18f95104f217 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.376177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.377185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.377470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.378036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.378759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.379220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.381204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.387132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.387955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.388291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.388662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.389558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=fe4065401c1645baa29331521821162e) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.389921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.391392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.396022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 383/753] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:44.396832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.402094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 371/754] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/role_assignments?user.id=fe4065401c1645baa29331521821162e&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:44.402961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.590080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868105-b523-4665-9f62-4121fbcd5ccb None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.603178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09698e-e1b5-42a7-b5c1-866fb4c7c592 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.655276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.655885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.656166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.656437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.657147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.657444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.658818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.662376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.663172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.663450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.663725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.670730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.672210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.675055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 384/755] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:44.676317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:44.687634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:44.690683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:44.692571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 372/756] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:44.699876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.780172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492969c2-9ea6-46ce-892a-e339767fa524 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.814470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.815339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.815756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.816053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.824512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.825958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.830935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9fd3-12c5-44a0-87dc-8d3c68fbf771 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-37ec0cdb-f283-4817-a1c7-b28592312e0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:44.840514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:44.842605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:44.844806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:44.850444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 385/757] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:44.850444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a19c7-77fd-4018-a259-9928308c1770 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.850444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a19c7-77fd-4018-a259-9928308c1770 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.850444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a19c7-77fd-4018-a259-9928308c1770 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.850444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 386/758] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:44.851244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a19c7-77fd-4018-a259-9928308c1770 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.872966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.873635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.874357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.874637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.875704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.876042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.878260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be73c1-5717-481d-8733-9c034273409a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:44.893115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 373/759] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:44.894562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.894852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.895123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.915981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:44.916878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:44.959683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a19c7-77fd-4018-a259-9928308c1770 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:44.993322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:44.994535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:44.995107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:44.995650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:44.996278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 374/760] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:44.996914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:44.997428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:44.997924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:44.999616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.043509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 387/761] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:40:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:45.044667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.112521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4c97-3205-4d8a-bdb2-152e5661c999 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.145623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665e55-ef7d-47ad-b3e7-bcd2968d32fd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.147169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.148401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.148885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.149347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.151589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=c491e8f0641945908a72a96a8e2927c5, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.153257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.168138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 375/762] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:44 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:45.169350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.180269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.181097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.181376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.181653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.182315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.183941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:45.196775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:45.197829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:45.198662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 388/763] 10.222.0.11 () {56 vars in 1129 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:45.204406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.292352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b5bc2-69b8-4af4-b0ac-eb50896c2c89 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.311632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426ea66-8a72-4c00-82b3-f18c20d9f2e4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.327759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.328794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.329267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.329835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.350093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.350809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.351075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.351594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.352073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:45.352382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.353787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.359168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 389/764] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:45.364931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.405372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.407596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.474640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1425-7435-4d2f-9f38-b02f72eb2cf7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.510242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 376/765] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:40:45.511251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.514605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.514605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.514605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.514605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:45.514605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.514980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.516030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.520455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 390/766] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:45.531812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.701499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e936459-b279-4357-850d-9f424a6168c7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.712849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee26f4-e9b1-4334-a19b-a90ed8964f70 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.749493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.750075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.750357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.750632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.751414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] RBAC: Adding query filter params (interface=public, service_id=083c3e83b4864a55b791da1a43546d1a, region_id=RegionOne) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:45.751723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.753187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.761075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 391/767] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/endpoints?service_id=083c3e83b4864a55b791da1a43546d1a&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:45.766409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.785955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.786761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.787039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.787307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.813024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.814500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:45.844723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:45.845668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:45.846588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:45.846588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:45.846588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:45.846588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:45.852203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 377/768] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:45.857576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:45.866639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22798-47be-474c-a2a0-b86eedaf4548 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:45.905819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:45.906487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.906769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.907048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.907723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:45.909270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef0302-2eea-4f75-81f8-297667f32470 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:45.915018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 392/769] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:45.924606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b36d6-75e2-4e18-91a0-d938452722ee None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.924925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b36d6-75e2-4e18-91a0-d938452722ee None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.925156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b36d6-75e2-4e18-91a0-d938452722ee None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.926908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 393/770] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:45.932354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:45.932641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:45.932832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:45.983966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44bea5-1fc3-409d-9a6f-1066e946d290 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.084750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.085369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.085650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.085924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.086695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:46.087002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.088545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.107889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:46.109106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:46.118729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 378/771] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:46.124621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.176859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 394/772] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:46.198519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.250338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7765-294a-4153-82e0-a5a6290cadc9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.283818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.285115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.285394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.285662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.292672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.294126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.297289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3b4f4-9fbf-4f1b-a050-5f0550c65286 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:46.308308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:46.309217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:46.310333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 379/773] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:46.320872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.339460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.340268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.340591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.340867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] PATH_INFO: `/v3/services/network` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.341517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.342881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:46.368008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:46.371184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:46.373160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 395/774] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:46.381148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.515603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b394-1354-4918-bfda-02f2ed60ded8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.531199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ea9f-788f-40a9-a0c5-2d905ac66d53 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.569658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.570328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.570604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.570876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.571576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:46.571914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.573287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.581637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 396/775] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:46.587310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.604512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.605110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.605380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.605647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.606432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:46.606735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.608204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.629581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 380/776] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:46.635701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.792205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360b5d-6fb3-40bc-8621-c9f4c63629d4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.799410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f823d4e-ae48-4768-999d-6b1109f56b3f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:46.850259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.850928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.851207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.851479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.852926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c714cc67e58f41db9fc9a37671111ba8) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:46.853235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.854775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.859048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:46.859732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:46.860035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:46.860306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:46.861016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] RBAC: Adding query filter params (type=network) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:46.861317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:46.862784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:46.869768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 381/777] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/role_assignments?user.id=c714cc67e58f41db9fc9a37671111ba8&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:46.873310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 397/778] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:46.879505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:46.984251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a44b-a1a9-4a8c-b984-c103ad208996 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:47.025252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:47.025940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.026219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.026492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.027295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] RBAC: Adding query filter params (interface=public, service_id=24d2d2174ba04c1b9c5c0b55ceba2470, region_id=RegionOne) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:47.027602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:47.029009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90254-563f-403b-89d8-35466413bc1c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:47.037729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 382/779] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:40:46 2022] GET /identity/v3/endpoints?service_id=24d2d2174ba04c1b9c5c0b55ceba2470&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:47.043204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:47.073286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8571-af08-473f-99fd-7467bd8f1031 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.073604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8571-af08-473f-99fd-7467bd8f1031 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.073833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8571-af08-473f-99fd-7467bd8f1031 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.075203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 383/780] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:47.086274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.086890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.087396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.118423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:47.121316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:47.186876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85227c33-39a2-4a33-b6da-bed879e5d248 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:47.220128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 384/781] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:47.245350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:47.258279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:47.259228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.259510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.259804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.260478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:47.262010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:47.278477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 398/782] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:40:47 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:47.381077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4099e1-908b-4fcf-802a-58127b5d4e40 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:47.418332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:47.419262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.419543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.419837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.430775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:47.438415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:47.439375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:47.440351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 385/783] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:47.453160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:47.575951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81849ff-f9a8-47c4-b86b-7a85672d3552 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:47.614315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:47.614988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.615273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.615553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.616642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:47.616949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:47.618321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:47.627963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 399/784] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:47.633845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:47.770284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a44b-1c2e-42ec-85cf-3a5ff05744a9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:47.807140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:47.807961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.808241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.808511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.819363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:47.820843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-d0a41720-d93d-437f-a33a-8759a7aa8033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:47.837751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:47.838668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:47.839574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:47.839574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:47.839574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:47.839574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:47.839574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 386/785] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:47.845945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:47.909740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e918-27f2-472d-9b2d-3eedc3ac8494 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.910109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e918-27f2-472d-9b2d-3eedc3ac8494 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.910267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e918-27f2-472d-9b2d-3eedc3ac8494 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.911900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 387/786] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:47.916892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:47.917428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:47.917918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:47.945908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:47.948432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:48.015666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc03f2-6cec-4e5a-8378-48a16f596d65 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.038372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 388/787] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:48.055881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.056861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.057337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.057801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.058703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:48.059215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.060857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.072790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.085623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 400/788] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:48.089632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.230190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437601-4276-47c3-9b47-421faf17ecea None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.275594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ba4a-c929-4d22-89be-6723fc9f5689 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.276818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.278002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.278528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.278993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.298495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:48.313622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:48.314710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:48.315629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:48.320958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 389/789] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:48.326352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.348545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.349744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.350239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.350718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.362836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.365414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:48.394339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:48.395360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:48.396353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:48.401775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 401/790] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:48.407362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.496276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84db51-421e-43b9-9395-0f2d17f4e872 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.536048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.537160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.538928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.539398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.540361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:48.542332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.543970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.565459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 390/791] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:48.570547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.608985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f015e7-3f5c-4fd3-a395-df430d8b20e5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.656491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.657183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.657483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.657767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.658591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:48.659109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.660408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c4d8-3c66-43a6-8c57-65fbff227c50 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.673921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd16b-9f43-4722-a507-d3957707d1fe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.678404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 402/792] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:48.679834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9504e4-81cc-482b-b5f4-c06a944d02ba None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.680128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9504e4-81cc-482b-b5f4-c06a944d02ba None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.680404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9504e4-81cc-482b-b5f4-c06a944d02ba None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.681872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 403/793] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:48.688199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.688480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.688777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.705176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:48.706888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:48.712204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.713242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.713747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.714614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.727684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.730233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:48.751964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:48.752941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:48.753840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:48.753840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:48.753840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:48.753840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:48.756396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 391/794] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:48.757329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.787921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 404/795] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:48.789020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.899634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4006-9d0e-4c73-862a-ce7cec385c10 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.902737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f2b8-263b-4224-abc0-6090f4201f7a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:48.936412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.937439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.937918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.938413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.939313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:48.939573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:48.940133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.940611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:48.940890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:48.941157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:48.942323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.951568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:48.953273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:48.964087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 405/796] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:48.964984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:48.975252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:48.976231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:48.977140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:48.977140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:48.977140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:48.977140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:48.979284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 392/797] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:48.980310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.072863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c553f5-1fa1-4d31-9771-6e9dcf2573b1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.094124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8244-d8a5-49c2-9675-3f6e7968d461 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.106727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.107932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.108410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.108881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.109720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.111267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:49.123861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:49.124916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:40:49.125796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:49.128739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 406/798] 10.222.0.11 () {56 vars in 1129 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:49.129732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.136411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.137307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.137652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.137991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.148106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.149932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:49.168350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:49.169401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:40:49.170376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:49.174199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 393/799] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:40:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:49.175545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.254555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede393fd-c3bf-481f-b406-b0a2a5f52bfd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.285661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a737-cafd-4715-bf58-ec639a1bd9cf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.299615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.300362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.300640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.300912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.301663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:49.301967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.304016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.325048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 407/800] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:49.325219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.363792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.363792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.363792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.363792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.364224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:49.364811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.366696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.378249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 394/801] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:49.380223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.441998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed340e48-8b9a-4b49-829d-1a7a4a3d3dee None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.478528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.479553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.480082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.480570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.481592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:49.482096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.483731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.503599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 408/802] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:49.504905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.517851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd8a79-fb5f-43b8-aeb4-f50b81df6fcf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.562974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.563792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.564085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.564354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.571108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.572570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-8a0e2d72-bfbb-4947-aec0-9bfca42bd299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:49.586559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:49.587482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:49.588771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 395/803] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:49.589479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2aefa-5483-4926-b16b-2b20f6580996 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.589590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2aefa-5483-4926-b16b-2b20f6580996 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.589867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2aefa-5483-4926-b16b-2b20f6580996 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.595488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 396/804] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:49.596361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2aefa-5483-4926-b16b-2b20f6580996 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.623205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d618-73a0-4c19-a878-703bc92e13a0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.657915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.658681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.659000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.659268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.660115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:49.660534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.662019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.666729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 409/805] 10.222.0.11 () {56 vars in 1124 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:49.667501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.703431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2aefa-5483-4926-b16b-2b20f6580996 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.744312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.745458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.745835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.746250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.786793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935c9c-64db-4bf8-9868-44f0fd422ba6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:49.837118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:49.838466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.839147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.839580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.839694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.840631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:49.841080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:49.841192 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.842885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d53e8-464d-4536-9672-c1433af7de59 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:49.858427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 410/806] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:49.859904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:49.860342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:49.861161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:49.881653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:49.883285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:49.942945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 397/807] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:40:49.942945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:49.956861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 411/808] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:49.957663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.034169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3577ddd-f855-45ff-a38a-c08d3de7f5b1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.050537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab6fa-eeb5-46c2-af0a-c0cdf0d172f8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.067134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.069274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.069560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.069837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.070576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.073599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.083595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.084504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.084844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.085125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/fe4065401c1645baa29331521821162e/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.087521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=fe4065401c1645baa29331521821162e, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.089178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392ec94-7ca2-4103-9907-0557ea44e3ca None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.096083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 398/809] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:40:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:50.096894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 412/810] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:49 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/fe4065401c1645baa29331521821162e/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea91e-a7da-4763-b28c-531531626942 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea91e-a7da-4763-b28c-531531626942 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea91e-a7da-4763-b28c-531531626942 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 413/811] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:50.112160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bea91e-a7da-4763-b28c-531531626942 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.255084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe4b8-7e57-468c-b4a7-9b42d0ee94b6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.257474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bea91e-a7da-4763-b28c-531531626942 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.301498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.302334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.302604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.302880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.304094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.304895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.305170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.305438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.316156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.317362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:50.318226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d5932bd0-c2dc-41ef-a2ff-09ebf036690c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:50.325238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:50.326188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:50.327445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 414/812] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:50.328393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.328393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.328533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:50.340052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:50.341191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:50.342092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:50.342092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:50.342092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:50.342092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:50.342587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 399/813] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:50.343307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.352874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:50.354425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:50.434224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 415/814] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:50.435089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.459215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4a428-4140-4d79-ac13-da8cb12f870a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.509786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.511044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.511760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.512237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.513430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:50.513899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.516123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.527304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 400/815] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:50.528444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.537676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f08888-c23a-482c-a6f5-495c3a7bc0fc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.571415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.572275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.572652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.573021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.573832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:50.574283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.575813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.587668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 416/816] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:50.593341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.644975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d481c9d-18b9-403b-8b55-cdf5aa08b47e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.684930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.685876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.686251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.686616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] PATH_INFO: `/v3/services/network` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.687511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.689147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:50.703010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:50.704737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:40:50.705844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:50.712400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 401/817] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:50.712400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.717756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e021-59a8-48d2-833f-9ec0e13e724c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.750641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.751372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.751749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.752021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.762338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.763849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:50.780670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:50.781601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:50.782502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:50.782502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:50.782502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:50.782502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:50.786699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 417/818] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:50.787741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.832599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c41c0-b38e-4535-bac0-2331f524fe23 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.874720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.876361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.876959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.877465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.886937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.889210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.890210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1194-3d4a-4b07-a8ba-76d25594e6b6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:50.907623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:50.908670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:50.909618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:50.912807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 402/819] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:50.913903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:50.930052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:50.930716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:50.930997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:50.931271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:50.932087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] RBAC: Adding query filter params (name=network) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:50.932357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:50.933845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:50.943144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 418/820] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:50.943144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.035270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337322-47ac-4882-b67b-89100d7a2a22 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.060271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a851-7aa5-4a3c-b4e7-bc2570e569b7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.079525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.080226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.080570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.080845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.082019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:51.082322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.083973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.095583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.096617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.097097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.097584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.098571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:51.099075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.100815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.102578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 403/821] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:51.103693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.114831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 419/822] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:51.116434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.222820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ced2-267d-4736-933e-19f6c6caf8ea None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.223540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae8fa0-bf6d-432b-a340-4ee68b2f8f1a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.259088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.259333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.259761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.260080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.260351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.261055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] RBAC: Adding query filter params (type=network) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:51.261307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.261408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.261862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.262335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.262709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.272182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 404/823] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:51.272182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.274865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.277451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:51.296288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:51.297306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:51.298270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:51.299841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 420/824] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:51.300826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.380848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c48c1-ea4c-42df-8e39-ff94a2ac9a10 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.401417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b315de-5975-4d79-b887-70c7dd422cad None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.414007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.414659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.414938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.415364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.416164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:51.416525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.418005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.428048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 405/825] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:51.428906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.437351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.438422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.438906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.439401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.440464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.442116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.482158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 421/826] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:40:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:40:51.615486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6858-6491-4da6-991a-4510f90cef65 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.676356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.677046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.677323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.677593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.679500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:51.679500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.680189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.705884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 406/827] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:51.712420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:51.832558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cda8d0-9133-477a-80ac-ece146e3920f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:51.864382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:51.865177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:51.865460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:51.866132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:51.876591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:51.878056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:51.894589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:51.895552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:51.896513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:51.896513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:51.896513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:51.896513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:51.896513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 422/828] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:51.901494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.007946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf408e-5ded-409d-9525-09dacfa010f8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.040216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.041129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.041571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.041983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.042832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:52.043367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.044895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.056604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 407/829] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:52.067788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.160519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a68e3-dbda-4e1a-a35b-d617935ec665 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.193427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.194225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.194556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.194882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.201663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.203163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:52.217285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:52.218165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:52.219056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 423/830] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:52.224486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322504f-0912-4824-bf85-728d36c35b38 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.362054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.363099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.363577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.364073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.365079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:52.365631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.367636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf660-fd08-4b90-94f1-67d85f9d5e01 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.382131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 408/831] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:52.387803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.483973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2390e-77f2-4fdd-a076-23c65e648c79 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.484166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2390e-77f2-4fdd-a076-23c65e648c79 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.484434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2390e-77f2-4fdd-a076-23c65e648c79 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.486049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 409/832] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:52.488834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03df13-061e-4531-a838-f98c474ee9d3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.491519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.491821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.492098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.509171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:52.510989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:52.522633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.523511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.523825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.524104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c714cc67e58f41db9fc9a37671111ba8/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.541437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=c714cc67e58f41db9fc9a37671111ba8, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.542903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a7d9d-72e0-4e42-ac04-b52ea7169dec None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.559473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 424/833] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:40:52 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c714cc67e58f41db9fc9a37671111ba8/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:40:52.573510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea9a8-c37f-4a2d-a405-024d7aea5878 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.573795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea9a8-c37f-4a2d-a405-024d7aea5878 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.574072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea9a8-c37f-4a2d-a405-024d7aea5878 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.575886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 425/834] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:52.581874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.582162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.582442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.599814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 410/835] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:52.604979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:52.606634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:52.623654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.701158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 426/836] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:52.723800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.741583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808f49a-2b7d-4314-a623-ba3c95a57a4a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.783171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.784079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.784358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.784623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.795057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:52.802607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:52.803532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:40:52.804470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:52.807877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 411/837] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:52.810071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.839826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4344ce4-6c91-4deb-a7af-9eda734cb4c4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.873852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.874621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.874902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.875203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.875962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.877385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:52.889081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:52.890104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:52.890938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:52.895250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 427/838] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:52.896591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:52.916014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd80740-aa93-46ed-a43a-2a3ef2122dbc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:52.949219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:52.950248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:52.950746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:52.951220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:52.952198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:52.952699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:52.954259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:52.963073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 412/839] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:52.969618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.006101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005e42-7c7c-4b2d-9cfe-0e6a41bd65f0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.044621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.045308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.045877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.046155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.047116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:53.047419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.049333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.059102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 428/840] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:53.060621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.087512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801fb7-00ed-4694-a6aa-844edc61c739 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.120393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.121184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.121469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.121722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.132233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.133675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:53.150547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:53.151499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:53.152425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:53.152425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:53.152425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:53.152425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:53.156395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 413/841] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:53.157252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.162278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963593-4104-4dd2-b371-c39f46dcfa86 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.195285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.196350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.196823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.197296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.198217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:53.198722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.200330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.211869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 429/842] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:53.259392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b09e-e626-4900-87d7-6388d6877bba None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.305930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.307000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.307476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.307971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.308893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:53.309414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.310998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.324937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 414/843] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:53.333310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.436365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dccb-6c61-4f08-a123-077f7bdc8386 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.469179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.470031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.470311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.470586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.478581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.480055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:53.494620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:53.495597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:53.496601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 430/844] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:53.503455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.603500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582949c-cb41-4f5d-bce7-9cc51b57bc98 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.637068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.637786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.638064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.638381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.639214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:53.639515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.640975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeec16-5d79-4099-8809-70afedce64f3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.658232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 415/845] 10.222.0.11 () {56 vars in 1135 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:53.663826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:53.770602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e65da-899b-4c24-979d-f42550b614f5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:53.803732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:53.804399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.804673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.804942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.869857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:53.871222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:53.921725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a4d6-c228-4185-9495-025ae78341e1 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.922275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a4d6-c228-4185-9495-025ae78341e1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.922275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a4d6-c228-4185-9495-025ae78341e1 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.923594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 416/846] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:53.928779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:53.929065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:53.929336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:53.946312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:53.947484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:53.989060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 431/847] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:40:53.995288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.028016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 417/848] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:54.043923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.107555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62cc83-d9f4-4d30-9684-4d68ee57b3ed None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.140578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.141379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.141650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.141916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.152078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.153522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.161948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e2e1-12ba-42d2-abdc-c27f80f0f264 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:54.170672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:54.172538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:54.173618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:54.173618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:54.173618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:54.173618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:54.173618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 432/849] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:54.179682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.198650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.199563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.199961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.200289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.201002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.202480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:54.214801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:54.215797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:54.216666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 418/850] 10.222.0.11 () {56 vars in 1132 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:54.224726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.293184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be95de-2ad0-45f4-8613-048bc65b86af None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.335598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.336300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.336584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.336860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.337577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:54.337880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.338089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079c42-2247-4273-aee1-d8878d2b35ae None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.339255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.356859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 433/851] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:54.362352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.379320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.380537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.380999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.381726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.382607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:54.383086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.385068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.396193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 419/852] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:54.397639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.467025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049d0a-1084-413c-b217-4fd2fe75fea6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.499537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.500385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.500651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.500922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.508022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.509274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.520854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb22c5-a6de-41de-9a20-bed8b613bb1f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:54.523866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:54.524760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:54.525660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:54.528029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 434/853] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:54.530597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.564197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.564645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.564965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.565240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.565940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:54.566242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.567612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.584274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 420/854] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:54.639496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0bea5-ce7c-4c0b-933d-043301391a85 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.676359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.676951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.677231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.677504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.678311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:54.678615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.680270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbd97-9b06-43fe-8eae-f7b5dd480cb0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.694650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 435/855] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:54.701026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:54.803156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312849-c4bd-4e1d-8dc5-955542429189 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:54.838052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:54.838711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.838996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.839266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.840130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=fe4065401c1645baa29331521821162e) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:54.840435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:54.841865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae6358-b029-4f6e-af5f-8db62429166d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:54.849432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 421/856] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/role_assignments?user.id=fe4065401c1645baa29331521821162e&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:54.869132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bad24-5028-4d4a-ae51-52aa0ab07f26 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.869445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bad24-5028-4d4a-ae51-52aa0ab07f26 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.869682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bad24-5028-4d4a-ae51-52aa0ab07f26 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.876573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 436/857] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:54.878599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:54.878892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:54.879169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:54.896997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:54.898195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:54.970012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 422/858] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:54.995632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bad24-5028-4d4a-ae51-52aa0ab07f26 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.097728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bad24-5028-4d4a-ae51-52aa0ab07f26 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.130851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.131925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.132342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.132752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.142919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:40:55.150783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:55.151897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:40:55.152945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:55.158698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 437/859] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:40:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:55.161524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.261643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147291-c9e1-4cfe-881d-479faef01e39 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.294532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.295496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.295978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.296436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.297361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:55.297834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:55.299403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:55.311862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 423/860] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:55.313893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.411470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2e9e-166b-4c43-bd64-8f013e821ffe None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.446683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.447475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.447754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.448054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.458739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:55.460222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-e0063361-21aa-4f46-858f-8c4aa03f82dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:55.477007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:55.477924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:55.479207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:55.479207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:55.479207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:55.479207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:55.479207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 438/861] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:55.485463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.584105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7ec53-ac35-4503-8a23-be36e0cac504 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.585513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b831-016d-451e-b6a6-bf2f577cc86f None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.585802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b831-016d-451e-b6a6-bf2f577cc86f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.586079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b831-016d-451e-b6a6-bf2f577cc86f None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.587582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 439/862] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:55.593178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.594073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.594570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.613892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:55.615130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:55.623465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.624841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.625323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.626103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.627350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:55.627875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:55.630172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:55.646119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 424/863] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:55.652151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.691789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 440/864] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:55.713268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.767603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a7080-7ad9-4b1b-95d6-6f17d1363f67 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.812322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.813589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.814339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.814869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.819806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc073a9-ce53-4b02-b4f6-2a288d53b1ea None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:55.824790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:55.826428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:40:55.846443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:55.847616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:40:55.848836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:55.851710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 425/865] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:40:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:55.856979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:55.861875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:55.862762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:55.863181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:55.863591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:55.864585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:55.866892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:55.891988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 441/866] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:40:55 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:40:55.966456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75777cb-e32f-43da-9b4e-304dd68a4cfa None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:56.009477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:56.010148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.010411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.010674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.011508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:56.011833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:56.013275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:56.035906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 426/867] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:40:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:56.038480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:56.143090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e59e6-b862-4a01-9fe7-d3fbee24cbc9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:56.176387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:56.177031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.177305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.177571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.252014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:56.253801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:56.351146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 442/868] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:40:56 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:40:56.357392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:56.465263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44bcd-34b8-464c-91d5-e5d6d69cf5ba None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:56.498486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:56.499321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.499598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.499898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.509878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:56.511320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:40:56.528246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:56.529179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:56.530510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:40:56.530510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:40:56.530510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:40:56.530510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:56.530510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 427/869] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:56.536695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:56.632676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb95ef-93f4-4dde-8a19-9d9d7ae4b899 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:56.674522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:56.675040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.675320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.675590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.676344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:56.676642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:56.678004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:56.689769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 443/870] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:56.695957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:56.799068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317c1e-eb93-4c8a-b69d-485fc57bbb06 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:56.833220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:56.834019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.834296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.834567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.841680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:56.843114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-9230f222-652d-44ca-8dc9-def167ea62be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:40:56.856854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:56.857798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:56.858957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 428/871] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:40:56.866860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:56.939990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8f79-5e1f-49d5-a05c-4b44a868b27c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.940191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8f79-5e1f-49d5-a05c-4b44a868b27c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.940474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8f79-5e1f-49d5-a05c-4b44a868b27c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.942046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 429/872] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:56.947140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:56.947451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:56.947687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:56.965024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:56.966212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:56.972340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b045b-1695-4be2-a517-57c3fd53680d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.007027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.008053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.008629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.009105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.010066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:57.010569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.012216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.030388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 444/873] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:57.032182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:57.039952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 430/874] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:57.057197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:57.132143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6387f-6eff-45d6-8b62-819a4b5bdcda None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.153497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f08d-5952-4276-ac77-6a46023ba415 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.165868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.166915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.167389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.167890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.168964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c714cc67e58f41db9fc9a37671111ba8) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:57.169492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.171169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407f48e-05e2-4949-bab3-bb0ed767080b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.183921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 445/875] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:40:57 2022] GET /identity/v3/role_assignments?user.id=c714cc67e58f41db9fc9a37671111ba8&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:40:57.189781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.190465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.190747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.191020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.192028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.193507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45552b-eb60-4523-903d-44ffab8c03a5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.215360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 431/876] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:40:57 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:40:57.223113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff683b-eada-41c2-8e0a-76770b32aad3 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.223443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff683b-eada-41c2-8e0a-76770b32aad3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.223666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff683b-eada-41c2-8e0a-76770b32aad3 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.225583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 446/877] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:57.231755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.232097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.232346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.251367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:57.252698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:57.335501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 432/878] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:57.358359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff683b-eada-41c2-8e0a-76770b32aad3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:57.470711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff683b-eada-41c2-8e0a-76770b32aad3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.504145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.504943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.505222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.505493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.506132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.507500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:57.519700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:57.520714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:57.521568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 447/879] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:40:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:57.526979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:57.628089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ddac6-0dc5-4766-9cfb-5c34944351da None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.661434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.662099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.662377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.662646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.663341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:57.663641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.665043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48b509-7771-4fbb-b8e5-76aa434c5770 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.670029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 433/880] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:40:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:57.676216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:57.780458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011139be-acaf-4213-9a91-558e26b06c01 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:57.813664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:57.815896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:57.815896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:57.815896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:57.819024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:57.819024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:57.819024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076cfa7-7d9e-4544-a2c8-5634c5939166 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:57.823045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 448/881] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:40:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:58.290719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb5af-a2c7-4c3b-b930-2fbaaf5037c0 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.291240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb5af-a2c7-4c3b-b930-2fbaaf5037c0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.291240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb5af-a2c7-4c3b-b930-2fbaaf5037c0 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.292855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 434/882] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:58.298136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.298531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.298693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.315813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:58.316972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:58.380442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 449/883] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:58.402549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb5af-a2c7-4c3b-b930-2fbaaf5037c0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:58.502874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb5af-a2c7-4c3b-b930-2fbaaf5037c0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:58.535742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:58.536558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.536830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.537097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.537740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:58.539096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:58.550764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:58.551744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:40:58.552645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 435/884] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:58.558153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:58.653089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a465c-b009-4514-a610-db628d695b37 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:58.686543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:58.687552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.688073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.688546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.689502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:58.690034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:58.691583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:58.696825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 450/885] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:58.702479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:58.799165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc96f-0d45-4950-87b7-1ee37d4ce85a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:58.831884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:58.832548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.832827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.833096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.833796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:58.834091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:58.835454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:58.840645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 436/886] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:40:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:58.846224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:58.942911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72d2-97fd-4e1f-ad80-ab144b62c3a9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:58.977583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:58.978292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:58.978569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:58.978839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:58.979620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] RBAC: Adding query filter params (interface=public, service_id=c6373682662e463ca51df2590a74f8c4, region_id=RegionOne) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:40:58.979951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:58.981308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e30e-3141-4862-8474-ecb1f56cb0b9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:58.990555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 451/887] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:40:58 2022] GET /identity/v3/endpoints?service_id=c6373682662e463ca51df2590a74f8c4&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:40:58.996342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:59.093542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a5aa-4c75-4cfc-ae52-9a4f201d0692 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:59.129087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:59.129758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.130036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.130307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.132887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:59.132887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8d45a-1dbf-47e9-b46e-da79a9683c89 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:59.138779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 437/888] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:40:58 2022] GET /identity/v3/services => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:40:59.573618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad3eb-fbd9-48f0-bacc-94a49bc6cf0e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.574151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad3eb-fbd9-48f0-bacc-94a49bc6cf0e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.574151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad3eb-fbd9-48f0-bacc-94a49bc6cf0e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.575911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 452/889] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:40:59.581177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d930-11a1-4661-b2c8-f80734cc83db None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.581614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d930-11a1-4661-b2c8-f80734cc83db None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.581793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d930-11a1-4661-b2c8-f80734cc83db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.598427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-eeb1d930-11a1-4661-b2c8-f80734cc83db None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:59.599597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eeb1d930-11a1-4661-b2c8-f80734cc83db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:59.664699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 438/890] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:40:59.687913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad3eb-fbd9-48f0-bacc-94a49bc6cf0e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:59.701217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01282b-9158-41f4-83d4-eb601206b70a None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.701528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01282b-9158-41f4-83d4-eb601206b70a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.701780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01282b-9158-41f4-83d4-eb601206b70a None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.703295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 439/891] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:40:59.709224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.709512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.709789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.729978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:40:59.731326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:40:59.798791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad3eb-fbd9-48f0-bacc-94a49bc6cf0e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:59.815837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 440/892] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:40:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:40:59.832887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:59.838467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:59.839632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.840080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.840490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:40:59.841306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:40:59.842821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:40:59.855154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:40:59.856293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:40:59.857124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:40:59.859662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 453/893] 10.222.0.11 () {56 vars in 1132 bytes} [Tue May 3 08:40:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:40:59.866168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:40:59.949718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5274b-54b0-47f3-811e-8b9b5237ef6b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:59.974153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e0ae-2f92-43ca-bc41-a718166de4d8 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:40:59.988394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:40:59.989603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:40:59.989885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:40:59.990160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.004132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:00.009260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.010170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.010655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.011119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.012040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.012553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:00.013698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:00.014595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:00.015479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:00.017260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.020307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 441/894] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:40:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:00.021500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.024742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 454/895] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:40:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:00.029859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.127823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c72a-137a-4562-a0c1-d7c6bc48cebc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.139478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e665-25f4-427c-9997-e672d16f76e6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.160235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.160942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.161189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.161468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.162204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.162509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.163898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e443c-b9b5-4c68-ac9e-0cf096b14a59 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.171824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 442/896] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:00.171970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.172381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.172657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.172928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.173616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.173995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.175340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11852a2d-a352-4d8a-873f-f442e55d45eb None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.177449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c319d-9750-481f-85eb-acafb49a7c39 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.177742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c319d-9750-481f-85eb-acafb49a7c39 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.178021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c319d-9750-481f-85eb-acafb49a7c39 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.179672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 443/897] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:00.180381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c319d-9750-481f-85eb-acafb49a7c39 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.184140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 455/898] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:00.185421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.185705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.185978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.203130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:00.204663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:00.278041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 456/899] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:00.279057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.296767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c319d-9750-481f-85eb-acafb49a7c39 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.332806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.333907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.334186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.334457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.345283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.346804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:00.363662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:00.364757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 444/900] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:00.366108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.389666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989dd2b-c6a5-4415-8f36-c2198f9dd3e1 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.421801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.422455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.422733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.423006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.423841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] RBAC: Adding query filter params (interface=public, service_id=4d578a88f3674c5db915148a599ce4c6, region_id=RegionOne) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.424158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.425520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.430275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 457/901] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/endpoints?service_id=4d578a88f3674c5db915148a599ce4c6&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:00.431037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.473150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2dc6-b780-4325-8e90-d03e6d00d4f4 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.511481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.512212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.512487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.512752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.513465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.514839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.529377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 445/902] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:41:00 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:00.530470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.553575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb9375-a7ce-47a9-b36a-1d28940890cd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.602602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.603495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.603943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.604373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.605220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.605570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.607122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.625188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 458/903] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:00.626311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.645280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe71c-d130-4be3-9749-17511a9a1b03 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.688095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.689313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.689614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.690056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.691179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.693060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.700529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 446/904] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:41:00.742118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8f25-b4d1-4f76-9df6-f82548949861 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.779167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.780047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.780327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.780598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.789947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.791542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:00.814182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:00.815245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:00.816231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 459/905] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:00.823444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:00.931378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852462b6-11a2-46ad-bb67-6804057ac52c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:00.964203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:00.964873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:00.965150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:00.965419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:00.966257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:00.966563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:00.968018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:00.986219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 447/906] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:00.992261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.089274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002daa36-f104-423e-a876-1c8636e2fe43 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.123436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.124448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.124973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.125437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.190309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.192221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e5200-1c2e-4813-8420-fa378560cf2a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.296131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 460/907] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:01.297834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.393611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19912c1-4515-494e-826e-e10042f2169e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.427479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.428318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.428597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.428870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.432267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4478e-0bd2-4e9a-a261-d84c10b9f1a8 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.432556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4478e-0bd2-4e9a-a261-d84c10b9f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.432832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4478e-0bd2-4e9a-a261-d84c10b9f1a8 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.434368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 461/908] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:01.439120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.440673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.440801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.441095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.441468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:01.459959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:01.460909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:01.461794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:01.461794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:01.461794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:01.461794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:01.464088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 448/909] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:01.475215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:01.475215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:01.475457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.545865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 462/910] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:01.573430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.582793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f01d-a483-412a-b861-f80c8b8e5954 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.632493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.634151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.634934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.635694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.637296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:01.638172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.640936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.661739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 449/911] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:01.668485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.695854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae689911-def8-41fb-b49b-a823217a03fe None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.735948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.736780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.737055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.737329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.738456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.740139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:01.755070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:01.756226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:01.757218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 463/912] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:01.771803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.776790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa6aa-f780-4101-8ed5-5bbb40180dd1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.811300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.812262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.812607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.812946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.820447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.821980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:01.836436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:01.837364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:01.838254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 450/913] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:01.844706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.864207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2f08-ee05-4f9d-b4b6-7704151c7fe9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:01.896240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:01.896897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:01.897175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:01.897445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:01.898134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:01.898433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:01.899819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:01.904824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 464/914] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:01.910170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:01.970761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbef2c3-40a2-4c1c-a328-700bbf1e7776 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:02.006329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:02.007163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.007706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.007956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.008838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:02.009231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:02.010750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:02.017657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9f7f-b6f6-4398-a3af-938a6c934b5f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:02.027009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 451/915] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:02.028686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:02.061368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:02.063168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.063668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.064210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.065159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:02.065673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:02.067683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:02.074830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 465/916] 10.222.0.11 () {56 vars in 1114 bytes} [Tue May 3 08:41:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:02.081201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:02.129990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc2d3-ef42-4116-b097-3e9c7c4d8785 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:02.163262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:02.163678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.163990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.164259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.165135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] RBAC: Adding query filter params (role.id=bf98d023eaec4a9c9e385718203e7bcf, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c714cc67e58f41db9fc9a37671111ba8) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:02.165442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:02.166925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a32e0-e074-4383-8bc3-eead8e0ab764 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:02.179803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 452/917] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:02 2022] GET /identity/v3/role_assignments?user.id=c714cc67e58f41db9fc9a37671111ba8&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=bf98d023eaec4a9c9e385718203e7bcf => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:02.197978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352053b-4522-4397-8146-04de1a400f14 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:02.241482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:02.242071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.242352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.242625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.243374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:02.244824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06b06a-62ea-4d18-bfb9-f33dd95c4e97 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:02.267434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 466/918] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:02.941643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6581c0-9c37-462f-97fc-5fe8b045cd5e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.942174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6581c0-9c37-462f-97fc-5fe8b045cd5e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.942174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6581c0-9c37-462f-97fc-5fe8b045cd5e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.943823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 453/919] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:02.949325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:02.949759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:02.949954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:02.967461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:02.968669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:03.030327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b193c-1ace-4cfa-8a6d-56bb269de756 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.030641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b193c-1ace-4cfa-8a6d-56bb269de756 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.030874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b193c-1ace-4cfa-8a6d-56bb269de756 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.032486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 454/920] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:03.037490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.037773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.038043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.043860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 467/921] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:03.054547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:03.055706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:03.063350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.143904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 455/922] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:03.158607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.170010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d850e-9a11-4190-898d-1e69696e3e47 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.215017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.215224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.215518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.215823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.216642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.223786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:03.233507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:03.234499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:03.235324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:03.239861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 468/923] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:03.241935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.261281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b593ba-b2c1-41dd-a320-f45b9343bea2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.306341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.307720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.308064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.308346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.309455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.311293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:03.326348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:03.328673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:03.329855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 456/924] 10.222.0.11 () {56 vars in 1132 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:03.339811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.363709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c545-ee66-46ff-ac59-a2bc6590bcab None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.402894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.403558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.403860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.404128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.404818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:03.405113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.406462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.411612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 469/925] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:03.418287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.448328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a627-c2c2-440e-8248-7a347a4e4203 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.481428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.482049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.482376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.482647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.483340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:03.483639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.486542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.496037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 457/926] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:03.497524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.534978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637e87-75aa-4450-ab22-12930457e0b0 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.579347 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.580132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.580837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.581122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.582096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:03.582401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.584529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.591972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebff49-85ae-4957-8b3e-a513ec92702a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.595856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 470/927] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:03.597497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.634629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.635293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.635989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.636274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.636979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:03.637622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.639319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.645887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 458/928] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:03.651431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.700612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601039-788a-49f9-bbd5-a646db1ca112 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.732314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.733224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.733669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.734148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.735135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] RBAC: Adding query filter params (interface=public, service_id=bce3f41309254be4b2cb2c42266b3e64, region_id=RegionOne) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:03.735650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.737325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.743401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 471/929] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/endpoints?service_id=bce3f41309254be4b2cb2c42266b3e64&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:03.751153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:03.767108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e242e-2922-4251-b4d3-66de3698c9e2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.801958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.802621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.802903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.803178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.804102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.806098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ca12-d009-44d1-b177-86de85965d7f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.831143 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 459/930] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:03.871927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddf9a-2e17-4fe7-8589-88a8dba36b51 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:03.917763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:03.918919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:03.919447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:03.919989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:03.920964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:03.922704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30e3d-50ea-487b-8865-76f8b4d25edf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:03.933971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 472/931] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:41:03 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:41:04.494029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98769-e1e7-4b69-9a27-3084f5edcd86 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.494956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98769-e1e7-4b69-9a27-3084f5edcd86 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.495396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98769-e1e7-4b69-9a27-3084f5edcd86 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.497164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 460/932] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:04.502802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.503566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.504100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.521740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:04.523129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:04.568979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d80-0831-4d90-937b-4a3081ebaa06 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.569314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d80-0831-4d90-937b-4a3081ebaa06 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.569542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d80-0831-4d90-937b-4a3081ebaa06 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.571153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 461/933] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:04.575855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.576145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.576422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.592823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:04.593681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 473/934] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:04.593997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:04.616224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:04.662896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 462/935] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:04.686045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:04.714997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee580831-b79d-40fa-826a-d18be3391247 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:04.749336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:04.750508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.750987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.751474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.762233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:04.772387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:04.773386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:04.774261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:04.777051 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 474/936] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:41:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:04.782546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:04.783249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6321-6401-4162-aa22-5f64cf2106a2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:04.819012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:04.819666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.819975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.820248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.820945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:04.822382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:04.823743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING keystone.server.flask.common [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 08:41:04.841862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.sql.core [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:41:04.841862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 08:41:04.841862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [parameters: {'id': '10db8dbecc1f495ea58f06615ca36dc1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 08:41:04.841862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10db8dbecc1f495ea58f06615ca36dc1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10db8dbecc1f495ea58f06615ca36dc1. May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:41:04.851499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 08:41:04.852401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application yield resource May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise self.value May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application session.commit() May 03 08:41:04.853426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.flush() May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application compat.raise_( May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:41:04.854891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:41:04.856130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:41:04.858441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [parameters: {'id': '10db8dbecc1f495ea58f06615ca36dc1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:04.860651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:04.867589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10db8dbecc1f495ea58f06615ca36dc1. May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 463/937] 10.222.0.11 () {60 vars in 1140 bytes} [Tue May 3 08:41:04 2022] POST /identity/v3/projects => generated 262 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:04.869764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:04.930487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868655f1-e32c-4c17-a935-68e309670eac None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:04.977414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:04.978923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:04.979410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:04.979890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:04.980864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:04.981031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd99080-f8f4-4559-853c-fd2f65f3d3da None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:04.981508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:04.983263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:04.998101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 475/938] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:05.007567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.021911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.022753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.022990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.023264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.030251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.031931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:05.046142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:05.047172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:05.048413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 464/939] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:05.054190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.111375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90beda3-b98d-4254-92d0-69cfb732c171 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.146843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.147809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.148210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.148582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.153743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c271-8caf-44f6-bffa-723598d6089d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.159611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.161298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:05.178833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:05.179970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:05.181073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:05.181073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:05.181073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:05.181073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:05.187042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 476/940] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:05.187332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.188037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.188194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.188297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.188576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.189552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:05.189859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.191288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.218724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 465/941] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:05.306918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbe00-ff9a-4b39-8390-89c90d99c740 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.343365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.344461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.344976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.345519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.346472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:05.346976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.348615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.362330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 477/942] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:05.369905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.474458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7443b8-ed29-44e3-b8f7-8b369bc545e1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.515467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.516343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.517131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.517419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.527557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.529048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:05.544535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:05.545525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:05.546495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 466/943] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:05.553511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.653236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33fc69-7895-4324-b03a-1590937b592a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.686976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.688037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.688571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.689117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.690192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:05.690727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.692434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.711012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 478/944] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:05.716845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.818957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc2f4-83e9-48b1-9eda-e24b116d2263 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:05.853764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:05.854958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:05.855454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:05.855964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:05.866602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:05.868388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:05.886070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:05.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:05.887989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:05.887989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:05.887989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:05.887989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:05.890223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 467/945] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:05.896157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:05.998871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023233-f33f-4b09-b5b4-22e47e8404bd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.031675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.032366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.032645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.032953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.033663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:06.033960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.035319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020aa8-b699-47ca-8795-c6086b50caa5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.047171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 479/946] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:06.052908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.136530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a53-be51-4908-a6a7-fff257058b37 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.136530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a53-be51-4908-a6a7-fff257058b37 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.136837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a53-be51-4908-a6a7-fff257058b37 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.138464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 480/947] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:06.143522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.143827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.144104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.160793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:06.161920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55e5f0-e6d2-4fc3-a3db-37ac64fdd726 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.162035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:06.204024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.205293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.211237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.211747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.219327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.221159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:06.235591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:06.236599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:06.237574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:06.238026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 481/948] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:06.240749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 468/949] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:06.246659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.253947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.344499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c99ce-c018-46db-82e5-606fd8bd84b8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.355707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd48-e0c6-4d35-ad1e-0072f6d73a1a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.377469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.378135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.378417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.378692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.379495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:06.379799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.381235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2628-ade5-411c-a668-ea35c2b2b176 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.388991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.390093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.390559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.390998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] PATH_INFO: `/v3/services/compute` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.391948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.392842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 482/950] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:06.393798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.394219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508febf-37c7-4fc3-9295-0fe3521c5ebd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.394510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508febf-37c7-4fc3-9295-0fe3521c5ebd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.394801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508febf-37c7-4fc3-9295-0fe3521c5ebd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.396404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 483/951] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:06.399009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508febf-37c7-4fc3-9295-0fe3521c5ebd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-9fcf0240-970e-4fde-8025-af67322fb0da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:06.411538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:06.412820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:06.413903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:06.417667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 469/952] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:06.418981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.419268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.419546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.436019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:06.437521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:06.508544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 470/953] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:06.509330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.509870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508febf-37c7-4fc3-9295-0fe3521c5ebd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.551260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.552164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.552447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.552725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c714cc67e58f41db9fc9a37671111ba8/roles/bf98d023eaec4a9c9e385718203e7bcf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.555003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=c714cc67e58f41db9fc9a37671111ba8, role_id=bf98d023eaec4a9c9e385718203e7bcf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.556493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.570545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 484/954] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:41:06 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c714cc67e58f41db9fc9a37671111ba8/roles/bf98d023eaec4a9c9e385718203e7bcf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:41:06.571613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.614401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f45e4-230a-4e81-a90d-5aa7bf2909d7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.650979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.651809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.652155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.652495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.653219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:06.653533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.654929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.660671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 471/955] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:06.673156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.702100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc259692-e031-4f8a-affb-52f5e87d83d1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.738654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.739477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.739758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.740062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.741495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.742432 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:06.755342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:06.756440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:06.757607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 485/956] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:06.763905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:06.809368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc74bf-98fa-4ee8-bbd4-d860851fa099 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.846975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.847962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.848444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.848910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.849819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:06.850336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.851922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.857052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 472/957] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:06.887147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527cbc2-d64e-4556-8458-1115189b50fe None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:06.924498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:06.925591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:06.926074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:06.926546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:06.927551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:06.928136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:06.929723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:06.935743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 486/958] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:06.942089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:07.050780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b29c8-27cb-40ac-94e3-47317e30713a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:07.086276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:07.086947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.087227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.087499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.088236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:07.088540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:07.089911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9345a-f661-479b-8774-07c2e265cc5f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:07.095576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 473/959] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:07.101138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:07.197360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af0f2-eb51-48a5-9075-0d1e0abd526f None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:07.240596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:07.241314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.241600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.241877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.242625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:07.244015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806278fa-e57a-4d71-b67a-c04e0bf8593e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:07.266005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 487/960] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:07.519551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce10d-9555-41e6-afdb-5094b2650ab8 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.519958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce10d-9555-41e6-afdb-5094b2650ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.520160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce10d-9555-41e6-afdb-5094b2650ab8 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.521848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 474/961] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:07.527281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.527580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.527884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.544616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:07.545789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:07.617921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 488/962] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:07.642645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce10d-9555-41e6-afdb-5094b2650ab8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:07.744255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce10d-9555-41e6-afdb-5094b2650ab8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:07.780749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:07.781339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.781618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.781887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.782621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:07.784118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:07.797862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.sql.core [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:41:07.797862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 08:41:07.797862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [parameters: {'user_id': '3cf369b9324a4b1fa83c473e25bf71b3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 08:41:07.797862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:41:07.806022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:41:07.806882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application yield resource May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application next(self.gen) May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise self.value May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application session.commit() May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:41:07.807856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.session.flush() May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application compat.raise_( May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:41:07.808769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:41:07.809657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application conn.query(q) May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application result.read() May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:41:07.810500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [parameters: {'user_id': '3cf369b9324a4b1fa83c473e25bf71b3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:07.811333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 08:41:07.813631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:07.815724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 475/963] 10.222.0.11 () {60 vars in 1131 bytes} [Tue May 3 08:41:07 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:07.821369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:07.910681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90b9c-d9f5-4206-a000-df1367b1f87b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:07.944095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:07.944891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:07.945172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:07.945445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:07.952635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:07.954082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-df92b6fb-7dcd-4eb5-b3e6-dc51b1bcdcc6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:07.969139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:07.971305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:07.973555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 489/964] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:07.979787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:08.080142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df5610-9165-4e1c-8a8b-cc629e663bfc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:08.114137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:08.114813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:08.115096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:08.115689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:08.116524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:08.116826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:08.118457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58f83-9291-42d7-8fd2-e4dd51814d49 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:08.157027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 476/965] 10.222.0.11 () {56 vars in 1101 bytes} [Tue May 3 08:41:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:08.871079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec6af-0a3e-4cb5-abfb-a37d02472ade None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:08.871825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec6af-0a3e-4cb5-abfb-a37d02472ade None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:08.871825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec6af-0a3e-4cb5-abfb-a37d02472ade None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:08.873178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 490/966] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:08.878434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91d83-5220-43f3-bbdf-a49af7b96e23 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:08.878868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91d83-5220-43f3-bbdf-a49af7b96e23 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:08.878964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91d83-5220-43f3-bbdf-a49af7b96e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:08.896631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-0ff91d83-5220-43f3-bbdf-a49af7b96e23 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:08.898125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0ff91d83-5220-43f3-bbdf-a49af7b96e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:08.967802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 477/967] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:08.994107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec6af-0a3e-4cb5-abfb-a37d02472ade None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.098656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec6af-0a3e-4cb5-abfb-a37d02472ade None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.140017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.140791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.141073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.141344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.152126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:09.160319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:09.161265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:09.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:09.163892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 491/968] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:41:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:09.164704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579874-c985-4a44-b9c5-a332e19a321c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.164998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579874-c985-4a44-b9c5-a332e19a321c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.165274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579874-c985-4a44-b9c5-a332e19a321c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.166617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 478/969] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:09.169440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.172390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.173516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.173791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.190266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:09.191447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:09.259870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 479/970] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:09.274752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778184-c7b0-457c-9226-5a93a620822a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.281638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.307873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.308529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.308803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.309072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.309799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:09.310097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.311453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.323640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 492/971] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:09.325103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.377661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f55653-61e9-4f5b-8f98-618d93a88d50 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.412988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.413527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.413809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.414078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.414794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.416191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.426186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c5d-b6c6-4165-b01d-3f4d3825d322 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.429609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 480/972] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:41:09 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:09.470807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.471613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.471940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.472213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.483875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.485343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ab8196cb-513c-488c-a673-6d6be4bd9dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:09.503808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:09.504988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:09.506000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:09.506000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:09.506000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:09.506000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:09.506000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 493/973] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:09.513140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.546355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0073-5ef7-411f-8a40-d7c6bd3724d6 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.546642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0073-5ef7-411f-8a40-d7c6bd3724d6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.546931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0073-5ef7-411f-8a40-d7c6bd3724d6 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.548590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 494/974] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:09.554050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.554338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.554613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.571488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:09.572754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:09.618309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbc234-e2bd-48d3-8cef-808a8ba59447 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.641755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 495/975] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:09.652584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.653240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.653516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.653784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.654498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:09.654799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.656189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.664616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.667832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 481/976] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:09.673540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.764092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73e42-7b3f-47ae-a2b0-184a53c09546 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.770325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4ce4b-e4aa-45d1-8139-c91513f40164 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.798789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.799592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.799909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.800180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.800819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.802179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.803210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.804049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.804326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.804598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.811566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.813036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:09.814189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:09.815250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:09.816150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 496/977] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:09.821266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:09.831389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:09.832566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:09.833536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 482/978] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:09.838093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.920595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de25c-749c-4851-a93d-5fec4ed54418 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.935759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69773de8-47d6-4fe1-a63b-8dfaafb1d0d3 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:09.951948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.952708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.952987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.953259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.953948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:09.954241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.955665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.960408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 497/979] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:09.965984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:09.972836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:09.973500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:09.973775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:09.974044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:09.974867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:09.975168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:09.976607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:09.998485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 483/980] 10.222.0.11 () {56 vars in 1149 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:09.999433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.059896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460587a4-a64f-460a-a63d-1576dccbd916 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.090997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8d0e-c0d7-4d85-8095-427d30051ae0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.091333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.092120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.092403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.092679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.093380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:10.093677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.095096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.104134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 498/981] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:10.105577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.126421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.127389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.127675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.128005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.193094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.194456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.203014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e6900-7d7a-4759-9088-56b073b95a35 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.237329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.237992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.238272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.238543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.239339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] RBAC: Adding query filter params (interface=admin, service_id=bce3f41309254be4b2cb2c42266b3e64, region_id=RegionOne) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:10.239648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.241386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.246443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 499/982] 10.222.0.11 () {56 vars in 1249 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/endpoints?service_id=bce3f41309254be4b2cb2c42266b3e64&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:10.251968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.292285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 484/983] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:09 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:10.297617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.353816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865f88-59b3-4cc0-b78a-78360e85f007 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.386755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.387413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.387689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.387991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.388658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.390092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.393656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404c45-72ca-4eef-b9ae-6fa01e2122a5 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.396297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 500/984] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:41:10.427541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.428378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.428625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.428918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.440479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.441934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:10.460987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:10.461941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:10.467660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:10.467660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:10.467660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:10.467660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:10.467660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 485/985] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:10.469588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.578465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384dc3-87b8-4e33-8e4e-eefb97836406 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.616960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.617626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.617906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.618177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.618884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:10.619186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.620588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.632500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 501/986] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:10.638042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.732939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa54faa-8156-43ff-bbc8-dc6cba537e59 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.765278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.766066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.766343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.766611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.773103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.774540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:10.787854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:10.788735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:10.789659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:10.791862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 486/987] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:10.795114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:10.893226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d785-f486-4ee5-b4aa-a333c9e0724e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:10.926205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:10.926858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:10.927088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:10.927460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:10.928184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:10.928498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:10.930004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b4f0-5584-46e1-8534-9b03c7722ca4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:10.946251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 502/988] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:10.947883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:11.053179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9b0a7-6a1a-4c3f-9e7a-ebc2054766a9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:11.086669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:11.087315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:11.087588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:11.087874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:11.088688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] RBAC: Adding query filter params (role.id=bf98d023eaec4a9c9e385718203e7bcf, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c714cc67e58f41db9fc9a37671111ba8) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:11.088987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:11.090405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4dc45-eeb2-4752-89b3-61274b083eb1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:11.096647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 487/989] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:10 2022] GET /identity/v3/role_assignments?user.id=c714cc67e58f41db9fc9a37671111ba8&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=bf98d023eaec4a9c9e385718203e7bcf => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:11.702361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf613de-d787-4231-84fc-f850cddeebdc None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:11.702699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf613de-d787-4231-84fc-f850cddeebdc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:11.702908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf613de-d787-4231-84fc-f850cddeebdc None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:11.704402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 503/990] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:11.709568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:11.709856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:11.710108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:11.726877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:11.728065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:11.794015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 488/991] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:11.816336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf613de-d787-4231-84fc-f850cddeebdc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:11.917322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf613de-d787-4231-84fc-f850cddeebdc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:11.950874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:11.951655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:11.951971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:11.952242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:11.952950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:11.954246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:11.966038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:11.967037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:11.968362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:11.975138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 504/992] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:11.975381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:12.073283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e6b82-cb20-4cf0-b410-c6c430999b36 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:12.107426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8900-d116-457a-949f-488c1af73466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:12.108365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8900-d116-457a-949f-488c1af73466 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.108781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8900-d116-457a-949f-488c1af73466 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.109226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8900-d116-457a-949f-488c1af73466 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.110057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8900-d116-457a-949f-488c1af73466 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:12.110519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8900-d116-457a-949f-488c1af73466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:12.112057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8900-d116-457a-949f-488c1af73466 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:12.117815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 489/993] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:12.123326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:12.223267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d692e-09e4-4e27-83da-8ed4879f5481 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:12.258860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:12.259516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.259756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.260098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.260787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:12.261128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:12.262438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:12.274195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 505/994] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:12.275460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8900-d116-457a-949f-488c1af73466 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:12.373270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8900-d116-457a-949f-488c1af73466 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:12.406324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:12.406963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.407209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.407529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.408353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] RBAC: Adding query filter params (interface=public, service_id=0fa3d7a2611f4076be9fa043653a5a40, region_id=RegionOne) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:12.408654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:12.410001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95029198-cc41-4432-89d7-bdb4f0db5af2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:12.419374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 490/995] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:41:12 2022] GET /identity/v3/endpoints?service_id=0fa3d7a2611f4076be9fa043653a5a40&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:12.420703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:12.522403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077679a1-4fdf-4f2f-b73d-fbd4fb43ad0a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:12.555454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:12.556136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.556419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.556690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.557366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:12.558733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03fbd0-ffe3-4731-ab5f-d528103b7cb5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:12.565364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 506/996] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:41:12 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:41:12.644818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464753-334b-428e-82a0-fc9895358a95 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.645102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464753-334b-428e-82a0-fc9895358a95 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.645532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464753-334b-428e-82a0-fc9895358a95 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.647026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 491/997] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:12.653016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.653349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.653551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.671509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:12.672762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:12.743847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 507/998] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:12.766278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7464753-334b-428e-82a0-fc9895358a95 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:12.864089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7464753-334b-428e-82a0-fc9895358a95 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:12.896451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:12.897248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:12.897525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:12.897776 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:12.898426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:12.899789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:12.911612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:12.912667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:12.913946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 492/999] 10.222.0.11 () {56 vars in 1126 bytes} [Tue May 3 08:41:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:12.919052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.012661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05804-2d51-4b46-acb3-27a45c69780a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.044433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.045088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.045366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.045636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.046326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:13.046618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.048044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.052959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 508/1000] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:13.058561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.152496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367876a-9790-46f2-b374-15eb31dda0cf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.187843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.188521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.188864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.189132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.189833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:13.190134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.191612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1f48-7eeb-42cf-bd95-279d0c019309 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.196910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 493/1001] 10.222.0.11 () {56 vars in 1122 bytes} [Tue May 3 08:41:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:13.204538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.301523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69b438-c543-4821-bdf9-358f9838293a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.335178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.335858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.336147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.336417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.337135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.338492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35990e-e0a3-4fd4-9698-7ad99fc5ab6f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.354314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 509/1002] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:13.360142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0444-fa8e-4c2e-9cf3-3222ec3e4ede None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.360451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0444-fa8e-4c2e-9cf3-3222ec3e4ede None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.360824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0444-fa8e-4c2e-9cf3-3222ec3e4ede None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.362343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 494/1003] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:13.368609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.368962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.369172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.386799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:13.388043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:13.463874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 510/1004] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:13.486204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0444-fa8e-4c2e-9cf3-3222ec3e4ede None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.591601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0444-fa8e-4c2e-9cf3-3222ec3e4ede None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.628836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.629659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.629937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.630206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.630851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.632254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:13.643717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:13.644737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:13.645594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 495/1005] 10.222.0.11 () {56 vars in 1105 bytes} [Tue May 3 08:41:13 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:13.651442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.752549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84fbd-73d1-4979-8a8a-f8107943dafe None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.785939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.786602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.786883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.787155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.787885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] RBAC: Adding query filter params (name=image) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:13.788187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.789558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d1fe-9f23-4722-bab0-1d6a41acaf93 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.794417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 511/1006] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:13.800036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:13.893090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b381cf-5e1b-4adf-abcc-af52bfc667d3 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:13.924350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:13.925007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:13.925288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:13.925558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:13.926256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] RBAC: Adding query filter params (type=image) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:13.926558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:13.927947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5038eb4-b942-4171-9bab-cf20876cf80a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:13.932613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 496/1007] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:14.811177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a961-70be-40bb-a221-9daac8faba08 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:14.811754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a961-70be-40bb-a221-9daac8faba08 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:14.811754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a961-70be-40bb-a221-9daac8faba08 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:14.813096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 512/1008] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:14.818456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:14.818861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:14.819036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:14.835823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:14.836975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:14.902948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 497/1009] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:14.926346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a961-70be-40bb-a221-9daac8faba08 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.034836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a961-70be-40bb-a221-9daac8faba08 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:15.070312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:15.071022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.071302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.071573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.072252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:15.073626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:15.085329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:15.086325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:15.092185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 513/1010] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:15.095065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.193178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663522-ddb0-4d07-bd55-716dc6c924f1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:15.227227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:15.227922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.228197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.228467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.229156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:15.229456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:15.230815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:15.235827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 498/1011] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:15.241811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.337562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822f742-cda3-4037-a7fe-8ddc41b33cdf None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:15.370539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:15.371193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.371468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.371736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.372453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:15.372754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:15.374106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12601-b5fd-404d-a7b2-575983914a13 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:15.379535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 514/1012] 10.222.0.11 () {56 vars in 1112 bytes} [Tue May 3 08:41:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:15.385468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.487322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72680e-0683-4726-a64c-e65e4d5891cc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:15.521970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:15.522685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.522963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.523241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.524079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:15.525446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60f117-8a2f-47b3-b1bf-f1b33ce99be3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:15.551807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 499/1013] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:15.572674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391dafa-ad7b-486a-889b-6e830b0b44d4 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.572985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391dafa-ad7b-486a-889b-6e830b0b44d4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.573264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391dafa-ad7b-486a-889b-6e830b0b44d4 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.574647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 515/1014] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:15.581876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.582178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.582450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.600124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:15.601251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:15.687813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 500/1015] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:15.708893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391dafa-ad7b-486a-889b-6e830b0b44d4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.811428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391dafa-ad7b-486a-889b-6e830b0b44d4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:15.844364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:15.845449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:15.845731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:15.846004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:15.847216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:15.848634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feaa3-aa03-4268-87c5-17dfde2f88d6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:15.850495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 516/1016] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:15.856483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:15.954731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa35f-9e78-437d-867a-bc2b1ea9ce8a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:16.000467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:16.001218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:16.001490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:16.001755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:16.002485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:16.003986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27a4f-1b00-46f7-837a-90a52c11cf08 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:16.030991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 501/1017] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:41:15 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:16.178648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dde20f-7f1e-4b35-a72a-629e7ae0e058 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:16.179004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dde20f-7f1e-4b35-a72a-629e7ae0e058 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:16.179197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dde20f-7f1e-4b35-a72a-629e7ae0e058 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:16.180771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 517/1018] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:16.186338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097319-fb4c-405c-b3af-c785ced29cb2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:16.186629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097319-fb4c-405c-b3af-c785ced29cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:16.186903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097319-fb4c-405c-b3af-c785ced29cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:16.205025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-73097319-fb4c-405c-b3af-c785ced29cb2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:16.208624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-73097319-fb4c-405c-b3af-c785ced29cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:16.281278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 502/1019] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:16.303491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dde20f-7f1e-4b35-a72a-629e7ae0e058 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:16.403505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dde20f-7f1e-4b35-a72a-629e7ae0e058 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:16.435837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:16.436851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:16.437399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:16.437878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:16.438794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:16.440399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb595c26-5e0f-4221-9879-ad9f1e6c5fd8 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:16.457565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 518/1020] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:41:16 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:17.874135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c88ca-2607-426e-b0d4-294b15d104fe None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:17.874685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c88ca-2607-426e-b0d4-294b15d104fe None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:17.874685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c88ca-2607-426e-b0d4-294b15d104fe None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:17.876081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 503/1021] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:17.881601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:17.882066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:17.882146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:17.901822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:17.903010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:17.984083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 519/1022] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:18.007612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c88ca-2607-426e-b0d4-294b15d104fe None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.110154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c88ca-2607-426e-b0d4-294b15d104fe None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.149766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.150656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.150934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.151199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.161722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-759ed168-f377-4408-954a-0eefe70cbd06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:18.170824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:18.172060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:18.178008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 504/1023] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:18.179998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.283728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114780c-5407-4f39-a38f-e2d93739f5bc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.309452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59116-5070-4840-82fb-ecb64f26481c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.309693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59116-5070-4840-82fb-ecb64f26481c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.309962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59116-5070-4840-82fb-ecb64f26481c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.311627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 505/1024] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:18.316662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.316951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.317217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.318805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.319661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.319977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.320243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.321086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:18.321390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.323794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.332642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 520/1025] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:18.335353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:18.336586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:18.337939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.412199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 506/1026] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:18.429799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.433808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876c46-6e24-4f06-ad73-4c5db44b68f2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.466255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.467420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.467909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.468357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.479836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.481288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:18.497885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:18.498805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:18.499719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:18.499719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:18.499719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:18.499719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:18.499719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 521/1027] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:18.504823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.524975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42f4da-40ac-41a6-8cd3-051760f2cea3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.561236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.562319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.562781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.563198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.564768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.566235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.568638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 507/1028] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:18.574387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.610251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b514ac-9e04-40eb-b12d-9a19adfab961 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.642295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.643215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.643676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.644141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.645003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:18.645468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.646984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.663240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 522/1029] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:18.664289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.671008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243a7d-aaba-4e11-9f80-e71c1d2882d8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.710179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.710990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.711551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.712320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.713758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dd4d7-5a18-4595-baf5-e3294a3fbae9 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.735265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 508/1030] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:41:18 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:18.743233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030e2-cfd2-40ee-8591-9a6a7dae757e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.743541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030e2-cfd2-40ee-8591-9a6a7dae757e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.743815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030e2-cfd2-40ee-8591-9a6a7dae757e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.745444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 509/1031] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:18.751253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.751539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.751845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.770206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:18.771410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:18.771580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b7b35-7e33-4856-a84f-f38d3be82964 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.808693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.810047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.810512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.810966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.822249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:18.823784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:18.840358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:18.841428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 523/1032] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:18.847894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.851097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 510/1033] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:18.876112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:18.954341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc610-bf73-4dbf-a4c5-c8f11fde90fe None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.972920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e32c6-1a87-4514-9909-a2026467c3ac None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:18.996192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:18.996839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:18.997278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:18.997516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:18.998417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:18.998789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.000387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.009668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.010497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.010774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.011047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] PATH_INFO: `/v3/services/image` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.011696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.013092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.020236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 524/1034] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:19.024689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:19.025912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:19.027005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 511/1035] 10.222.0.11 () {56 vars in 1105 bytes} [Tue May 3 08:41:18 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:19.029080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.033161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.128850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d7518-c46f-4ba1-874b-b5ad699d7488 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.133467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1384a25-239c-4c1c-92d9-afac600a8f57 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.163162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.163821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.164107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.164377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.169645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.170498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.170919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.171330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.172212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] RBAC: Adding query filter params (name=image) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:19.172688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.174356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.180046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 512/1036] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:19.185295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.236800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.238368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.287062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af64a7-9872-4c62-b9be-5e33dcfa8747 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.318917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.319581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.319890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.320164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.320888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] RBAC: Adding query filter params (type=image) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:19.321167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.322525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.327446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 513/1037] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:19.333049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.333836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 525/1038] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:19.339159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.433296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebce405-a5ef-48f0-974f-a93153a97c45 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.434855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f710-036a-4e57-82bb-f1ab8581a002 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.465860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.466577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.466860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.467164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.468349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.469007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.469288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.469601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.470382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] RBAC: Adding query filter params (interface=public, service_id=566b4565ab4d45b5a93b1d3dfdba6a95, region_id=RegionOne) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:19.470689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.472075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.477123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.477824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 514/1039] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/endpoints?service_id=566b4565ab4d45b5a93b1d3dfdba6a95&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:19.480779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.483076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:19.498487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:19.499414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:19.500456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:19.500456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:19.500456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:19.500456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:19.500456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 526/1040] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:19.505410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.581280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23df71-21c3-46bb-b638-c50fd7b65f1d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.600139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323822-27a0-4e70-aae5-31cff8b5a180 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.614411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.615386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.615668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.616002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.616658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.618026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.624949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 515/1041] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:41:19.635364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.636086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.636366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.636639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.637360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:19.637664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.639098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.652374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 527/1042] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:19.658168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.766530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9332f25-d855-41be-a257-c6ea8ed741fe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.802918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.803718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.804028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.804300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.811721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.813322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:19.828256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:19.829166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:19.830255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 516/1043] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:19.835307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:19.941375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb2a1f-2ebc-498d-9ff9-a6975561159b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:19.974258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:19.974932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:19.975250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:19.975415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:19.976235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:19.976536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:19.977959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9326ae-91a0-4513-a8c8-3cbfcabdac6c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:19.994774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 528/1044] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:19.996019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:20.093978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02c1a-f11d-4025-b292-c6e4b88213aa None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:20.127177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:20.127820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:20.128137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:20.128387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:20.129231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] RBAC: Adding query filter params (role.id=bf98d023eaec4a9c9e385718203e7bcf, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:20.129540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:20.130966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8f89f-0d15-4daa-aca1-7c62d4695aa8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:20.143812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 517/1045] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:19 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=bf98d023eaec4a9c9e385718203e7bcf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:20.985537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc99a-5a08-4903-845e-6b6adafe45ea None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:20.986089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc99a-5a08-4903-845e-6b6adafe45ea None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:20.986089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc99a-5a08-4903-845e-6b6adafe45ea None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:20.987576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 529/1046] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:20.992997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:20.993257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:20.993554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.010272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:21.011420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:21.078064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 518/1047] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:21.101773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc99a-5a08-4903-845e-6b6adafe45ea None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.205171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc99a-5a08-4903-845e-6b6adafe45ea None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:21.237537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:21.238244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.238519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.238792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.249018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:21.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:21.257945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:21.258802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:21.260167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 530/1048] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:21.264360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.357377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb3ac-2c40-44e2-a8c3-c82d0b0fbdbe None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:21.391671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:21.392370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.392617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.392909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.393636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:21.393937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:21.395282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:21.403616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 519/1049] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:21.409972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.508606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962be0c-8b84-49c0-9eba-e6f23460bab1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:21.542225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:21.543101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.543372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.543645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] PATH_INFO: `/v3/users/e08666b83e9549bcbbea8ca6e778353b` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.556792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] RBAC: Authorizing `identity:get_user(user_id=e08666b83e9549bcbbea8ca6e778353b)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:21.558227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483a45-2373-4b50-88bd-0d35de59f48f None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:21.560040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 531/1050] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/users/e08666b83e9549bcbbea8ca6e778353b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:21.565779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.667326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c949f-3fc2-4f64-b973-3a2d23e0d7f6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:21.710012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:21.710988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.711443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.711938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.780683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:21.782460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:21.867254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdb85-1644-4c5c-8ba7-45c9e87909fd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.867856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdb85-1644-4c5c-8ba7-45c9e87909fd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.868307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdb85-1644-4c5c-8ba7-45c9e87909fd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.869866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 532/1051] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:21.875000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:21.875478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:21.875802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:21.881569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 520/1052] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:21.887236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.892612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:21.893784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:21.962680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 533/1053] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:21.985776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:21.997889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d45b9-674e-4e6e-b258-987d5ebfcc1a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.030446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.031360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.031586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.031929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.033061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.034566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.036447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 521/1054] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:22.042410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.085060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db1ce1-2449-4694-ab35-bd8f0508a906 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.118032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.118813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.119088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.119354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.120023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.121453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:22.133010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:22.134081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:22.134959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 534/1055] 10.222.0.11 () {56 vars in 1105 bytes} [Tue May 3 08:41:21 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:22.140098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.143269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22562b49-f03f-4ce3-9619-709437934fee None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.176827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.177498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.177777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.178047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.179011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=27fa7f6366224f29a1ed592cbdc9280a, user.id=e08666b83e9549bcbbea8ca6e778353b) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:22.179324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.180851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.187032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 522/1056] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/role_assignments?user.id=e08666b83e9549bcbbea8ca6e778353b&scope.project.id=27fa7f6366224f29a1ed592cbdc9280a&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:22.257642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e5f1-c31a-429f-9788-09e8c8ba17b3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.294305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.294911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.295173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.295446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.296184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] RBAC: Adding query filter params (name=image) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:22.296489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.297909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8d53-1c44-4a62-b8ef-467ab7790405 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.303552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 535/1057] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:22.309309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.369544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8606d3-3cd2-475a-81cd-726f23216512 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.369866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8606d3-3cd2-475a-81cd-726f23216512 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.370092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8606d3-3cd2-475a-81cd-726f23216512 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.373262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 536/1058] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:22.376614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.376891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.377166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.393848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:22.395039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:22.416480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac282-420a-4b75-8eb3-d2f93ee3f514 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.450320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.450975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.451252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.451520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.452251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] RBAC: Adding query filter params (type=image) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:22.452551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.453999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.459060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 523/1059] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:22.466734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 537/1060] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:22.466885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.481556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.562301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cc808-72f5-4700-98dc-c6a066dd436f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.575384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf911-2374-4fa8-90b6-6b4da98706fa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.595110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.595791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.596079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.596352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.597083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.598454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.607335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.608340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.608693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.609142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.627808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 524/1061] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:41:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:22.628062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:22.628280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:22.629256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:22.630202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 538/1062] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:22.635943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.743932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f32d8-e375-4995-97b1-caf50b7cd2d8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.777922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.778599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.778874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.779138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.779911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:22.780210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.781588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.790644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 525/1063] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:22.796355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:22.895095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8c2dd-4fb4-4a92-bc62-febd6ab805d9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:22.926362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:22.927153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:22.927426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:22.927697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:22.937961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:22.939455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:22.956088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:22.957062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:22.958406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:22.958406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:22.958406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:22.958406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:22.958406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 539/1064] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:22.963286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.062760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bea0-321c-4850-a888-7c7bd251b9ef None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.098074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.098796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.098961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.099256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.099978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:23.100268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.101676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.113446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 526/1065] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:23.119185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.218287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953e4-2188-4095-a966-e56041f4be89 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.251612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.252431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.252712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.253007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.260256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.261679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:23.275198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:23.276167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:23.277144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 540/1066] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:23.284126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.383262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c317-3f73-40d5-b924-8a699716447c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.417047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.417707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.417996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.418246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.419069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:23.419371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.420819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.437626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 527/1067] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:23.443423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.542976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050fcb-7d16-45f6-b4ed-b8599d6b65d2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.576424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.577201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.577481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.577753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.588201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.589640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:23.605958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:23.606922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:23.607854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:23.607854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:23.607854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:23.607854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:23.611904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 541/1068] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:23.613338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.711757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5b15f-3a3b-49bf-b190-17a60a568a2c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.744842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.745508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.745793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.746066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.746778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:23.747081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.748482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.760521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 528/1069] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:23.766617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:23.862148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ff8c-05ef-454d-943e-9625928ea69a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:23.895448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:23.896270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:23.896514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:23.896812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:23.903522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:23.904990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:23.918826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:23.919732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:23.921409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 542/1070] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:23.927990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.026188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32eba7-495f-4415-aebd-3ea996146a35 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:24.064532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:24.065179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.065434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.065724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.066498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:24.066799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:24.068264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289276b-c38c-4e38-a4c6-6ea56a0db3d6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:24.080420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 529/1071] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:24.086501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.182991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1b96-a2ae-4cb0-8ed8-6cb3975d489b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:24.217880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:24.218789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.219068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.219468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/bf98d023eaec4a9c9e385718203e7bcf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.221966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=c491e8f0641945908a72a96a8e2927c5, role_id=bf98d023eaec4a9c9e385718203e7bcf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:24.223448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171799f-a7c6-4569-8330-830dad9f8df4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:24.238989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 543/1072] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:41:24 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/c491e8f0641945908a72a96a8e2927c5/roles/bf98d023eaec4a9c9e385718203e7bcf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:41:24.402052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0bcb-d635-442c-93f6-8b3cc9b91df2 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.402314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0bcb-d635-442c-93f6-8b3cc9b91df2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.402553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0bcb-d635-442c-93f6-8b3cc9b91df2 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.404201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 530/1073] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:24.409908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.410222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.410443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.427729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:24.428935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:24.497198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 544/1074] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:24.519073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0bcb-d635-442c-93f6-8b3cc9b91df2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.619849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0bcb-d635-442c-93f6-8b3cc9b91df2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:24.653121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:24.653948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.654274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.654544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.664360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:24.671896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:24.672843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:24.674166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:24.675849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 531/1075] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:24.679440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.781069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1029150-f09f-4515-81b9-84b7d8c64f0d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:24.814631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:24.815281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.815555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.815820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.816559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:24.816852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:24.818196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202316-1fd1-46bc-a20e-f34bd2d8585d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:24.827436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 545/1076] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:24.832300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.886451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0549f-803f-40cc-80b7-28040e0fd186 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.886791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0549f-803f-40cc-80b7-28040e0fd186 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.886996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0549f-803f-40cc-80b7-28040e0fd186 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.888393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 546/1077] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:24.893668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.893952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.894226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.911639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:24.912843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:24.933613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d74e-d220-40d4-9ce0-0f08181d6cf7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:24.965331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:24.966213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:24.966475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:24.966738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] PATH_INFO: `/v3/users/e08666b83e9549bcbbea8ca6e778353b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:24.967927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=e08666b83e9549bcbbea8ca6e778353b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:24.969395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:24.971163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 532/1078] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:24 2022] GET /identity/v3/users/e08666b83e9549bcbbea8ca6e778353b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:24.977064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:24.977209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 547/1079] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:24.999404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:25.074603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359aa79-da7f-4422-b689-89094bbebaa1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:25.093243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fae13-edb3-4c9b-a06b-102d6c534bb2 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:25.116580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:25.117463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:25.117734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:25.117994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:25.119195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:25.120672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:25.122997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 533/1080] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:24 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:25.127415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:25.128281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:25.128428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:25.128833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:25.129304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:25.207976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:25.209541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:25.227075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77689c-9882-4877-9f73-2786599b5791 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:25.259915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:25.260809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:25.261093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:25.261364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a/users/e08666b83e9549bcbbea8ca6e778353b/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:25.263331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fa7f6366224f29a1ed592cbdc9280a, user_id=e08666b83e9549bcbbea8ca6e778353b, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:25.264791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:25.279306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 534/1081] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:41:25 2022] PUT /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a/users/e08666b83e9549bcbbea8ca6e778353b/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:41:25.319393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 548/1082] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 08:41:25.325867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:25.432628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbada-868c-41c0-aebc-a4f2d6c9fcd8 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:25.471396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:25.472544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:25.472656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:25.474164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:25.484168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:25.485773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-f8aff969-4937-4b54-91c2-760ff2b9f6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:25.503131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:25.504103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:25.505184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:25.505184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:25.505184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:25.505184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:25.505184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 535/1083] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:25.510357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:25.607784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21888-4c39-43e4-be18-1cb8037460b2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:25.642161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:25.642819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:25.643099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:25.643361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:25.644113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:25.644426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:25.645796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b0a-2a63-4001-b882-c88064b1a716 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:25.657507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 549/1084] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:26.468193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932d84-0d6c-4ff7-90aa-7d7b9aad0411 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:26.468738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932d84-0d6c-4ff7-90aa-7d7b9aad0411 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:26.468738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932d84-0d6c-4ff7-90aa-7d7b9aad0411 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:26.470068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 536/1085] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:26.475241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:26.475655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:26.475827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:26.493304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:26.494506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:26.562346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 550/1086] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:26.585423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d932d84-0d6c-4ff7-90aa-7d7b9aad0411 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:26.688442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d932d84-0d6c-4ff7-90aa-7d7b9aad0411 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:26.720889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:26.721622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:26.721898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:26.722167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:26.731812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:26.740212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:26.741309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:41:26.742345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:26.743417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 537/1087] 10.222.0.11 () {56 vars in 1120 bytes} [Tue May 3 08:41:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:26.747440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:26.841862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c960-caa3-4e27-8426-dc8eb255566b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:26.876465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:26.877139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:26.877415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:26.877689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:26.878437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:26.878740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:26.880139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:26.888643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 551/1088] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:26.894562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:26.993726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5f67-a484-4139-8bae-4e0504f2bd45 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.027427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.028269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.028550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.028786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.039789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.041272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:27.058388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:27.059335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:27.060802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:27.060802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:27.060802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:27.060802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:27.060802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 538/1089] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:27.065376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.170594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746a5b6-914f-4a1e-8a28-042c33eeebe7 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.206079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.206747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.207027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.207303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.208048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:27.208351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.209711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.221898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 552/1090] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:27.227777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.328753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2e9de-d9ae-4ded-b14e-36f8781822c2 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.364266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.366671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.366953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.367227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.380996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.382451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-81a6b13a-b5ed-4d86-a7f4-5475ad3a5269 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:41:27.396634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:27.397604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:27.399010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 539/1091] 10.222.0.11 () {56 vars in 1093 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:27.403753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.499179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1bef3-ee05-4385-8f3a-10dadcd0ab10 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.500506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb774f-cbd5-46dd-a3a7-85a69dc0c3a0 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.500965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb774f-cbd5-46dd-a3a7-85a69dc0c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.501058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb774f-cbd5-46dd-a3a7-85a69dc0c3a0 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.502434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 540/1092] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:41:27.507602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.507905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.508177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.524829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:27.526010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:27.533829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.534486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.534764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.535033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.535877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:27.536180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.537592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.554189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 553/1093] 10.222.0.11 () {56 vars in 1133 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:27.559840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.589370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 541/1094] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:41:27.612267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.650527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de096-ddec-42f9-b8a8-65d3a6fb3712 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.686757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.687400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.687697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.687997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.716754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2120a5-4166-4ed5-a8bb-ac32e21aadbc None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.750346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.751157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.751453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.751686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.754614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.756092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.761590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:27.769134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:27.770083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:27.771222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 542/1095] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:27.776285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.847271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 554/1096] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 08:41:27.852981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.873203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab8e4-92ee-4417-b9a6-a07e0e8e3200 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.906154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.906831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.907110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.907379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.908138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:27.908440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.909805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:27.917513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 543/1097] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:27.923245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:27.945421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c11b-b907-4786-9e9c-0133144c1710 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:27.978456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:27.979243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:27.979515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:27.979788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:27.989901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:27.991316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:28.008049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:28.009012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:28.010079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:41:28.010079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:28.010079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:41:28.010079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:28.010079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 555/1098] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:28.014758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.018237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb933d9-a117-4032-bacb-7d6600bc25f0 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.050595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.051457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.051727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.052019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] PATH_INFO: `/v3/users/e08666b83e9549bcbbea8ca6e778353b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.053211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] RBAC: Authorizing `identity:get_user(user_id=e08666b83e9549bcbbea8ca6e778353b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.054617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.056236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 544/1099] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:27 2022] GET /identity/v3/users/e08666b83e9549bcbbea8ca6e778353b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:28.061883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.107449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc66fd-e2a2-46f3-9a2e-a49b05d385a2 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.140658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.141333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.141609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.141866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.142560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:28.142864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.144276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.154935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 556/1100] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:28.156014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93d2b0-d45b-414c-a549-034f8af52318 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.160573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.187866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.188503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.188778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.189045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.252303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b63e9-4c8b-4540-be1d-41f664ffd18a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.256024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.257467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.284856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.285667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.285939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.286207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.292932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.294366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:41:28.308598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:28.309499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:28.310554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 557/1101] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:41:28.315733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.349379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 545/1102] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 08:41:28.355205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.408503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f455b-7abb-4f9a-9986-4a91a53743dc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.439965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.440639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.440914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.441181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.441953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:28.442256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.443670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.449091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354181-2e1c-4543-8de4-5595312367ed None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.454850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 558/1103] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:28.460890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.482573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.483428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.483697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.483986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.485230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.486648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.488491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 546/1104] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:28.494635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:28.553049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c29e4-ca9f-4219-995b-946b2578abbc None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.584965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.585614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.585895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.586167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.586973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] RBAC: Adding query filter params (role.id=bf98d023eaec4a9c9e385718203e7bcf, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=c491e8f0641945908a72a96a8e2927c5) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:28.587280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.588745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4baa8-e49e-4ea1-befe-d53943590fc4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.590092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bb79a-b414-4cb7-821b-a45b1d5348eb None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:28.594425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 559/1105] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/role_assignments?user.id=c491e8f0641945908a72a96a8e2927c5&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=bf98d023eaec4a9c9e385718203e7bcf => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:28.623709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:28.624410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:28.624687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:28.624958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:28.625848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=27fa7f6366224f29a1ed592cbdc9280a, user.id=e08666b83e9549bcbbea8ca6e778353b) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:28.626153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:28.627660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa46c-1645-42b8-8572-f15f572d2403 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:28.634238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 547/1106] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:28 2022] GET /identity/v3/role_assignments?user.id=e08666b83e9549bcbbea8ca6e778353b&scope.project.id=27fa7f6366224f29a1ed592cbdc9280a&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:30.884655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee8f3-06c0-4fd2-af2a-7e8d33269014 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:30.885244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee8f3-06c0-4fd2-af2a-7e8d33269014 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:30.885244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee8f3-06c0-4fd2-af2a-7e8d33269014 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:30.887312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 560/1107] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:30.895026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:30.895454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:30.895567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:30.922491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:30.923675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:30.989205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 548/1108] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:31.014465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee8f3-06c0-4fd2-af2a-7e8d33269014 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:31.128039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee8f3-06c0-4fd2-af2a-7e8d33269014 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:31.166186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:31.166961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:31.167240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:31.167513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:31.168837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:31.170259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0a12c-f371-477b-a878-8be8f80cdbcf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:31.171870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 561/1109] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:31.177935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:31.280045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b3dbe-f750-41b1-a1cc-c2595f8b41ad None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:31.313522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:31.314173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:31.314445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:31.314707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:31.315398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:31.316852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7f148-f856-4011-9e3f-f6002dab17a1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:31.338433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 549/1110] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:41:31 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:33.586294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fae6-6bad-4ee0-891f-615da02672ce None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:33.587191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fae6-6bad-4ee0-891f-615da02672ce None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:33.587191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fae6-6bad-4ee0-891f-615da02672ce None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:33.589289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 562/1111] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:33.594747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:33.595200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:33.595309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:33.613423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:33.614897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:33.679902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 550/1112] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:33.704095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fae6-6bad-4ee0-891f-615da02672ce None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:33.820935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fae6-6bad-4ee0-891f-615da02672ce None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:33.854148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:33.854917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:33.855195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:33.855468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] PATH_INFO: `/v3/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:33.857069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] RBAC: Authorizing `identity:get_role(role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:33.858437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:33.859812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 563/1113] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:33 2022] GET /identity/v3/roles/3cc7ef3638714f57a89fac869553e946 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:33.865873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:33.965117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae40e4-26d4-4da4-a873-cf3f2ea4ad12 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:33.998741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:33.999594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:33.999946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:34.000196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] PATH_INFO: `/v3/users/2c2a7955c5a54f04a199554dc0458c53` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:34.013081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] RBAC: Authorizing `identity:get_user(user_id=2c2a7955c5a54f04a199554dc0458c53)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:34.014507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:34.016206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 551/1114] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:33 2022] GET /identity/v3/users/2c2a7955c5a54f04a199554dc0458c53 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:34.022525 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:34.126448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f188c-1337-4856-8aac-0fcaa14a145c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:34.159443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:34.160098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:34.160385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:34.160654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:34.229680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:34.231129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:34.326651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 564/1115] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:34.332913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:34.436233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814ba7-598d-4a9d-9091-e5f23e99a5bf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:34.470554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:34.471396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:34.471667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:34.471968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:34.473182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:34.474593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3914593-162d-4c6e-9343-183397b75eea None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:34.476297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 552/1116] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:34 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:34.482391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:34.595519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18dabf-d9c8-4600-921b-e10e6ae559b4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:34.631313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:34.631984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:34.632259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:34.632536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:34.633363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=27fa7f6366224f29a1ed592cbdc9280a, user.id=2c2a7955c5a54f04a199554dc0458c53) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:34.633671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:34.635132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a99a9-1435-4a14-af78-1279dcb812c3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:34.640721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 565/1117] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:34 2022] GET /identity/v3/role_assignments?user.id=2c2a7955c5a54f04a199554dc0458c53&scope.project.id=27fa7f6366224f29a1ed592cbdc9280a&role.id=3cc7ef3638714f57a89fac869553e946 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:36.847595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c96e-13c1-4cdd-95e1-711066778a7c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:36.848572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c96e-13c1-4cdd-95e1-711066778a7c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:36.848572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c96e-13c1-4cdd-95e1-711066778a7c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:36.850747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 553/1118] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:36.857189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:36.857627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:36.857733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:36.875505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:36.876708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:36.944102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 566/1119] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:36.966662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c96e-13c1-4cdd-95e1-711066778a7c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:37.072840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c96e-13c1-4cdd-95e1-711066778a7c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:37.105981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:37.106750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:37.107023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:37.107288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] PATH_INFO: `/v3/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:37.108777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] RBAC: Authorizing `identity:get_role(role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:37.110155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:37.111542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 554/1120] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:36 2022] GET /identity/v3/roles/3cc7ef3638714f57a89fac869553e946 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:37.121033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:37.215085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4450-7ffb-495a-9d88-360384088e08 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:37.251523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:37.252780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:37.253109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:37.253434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] PATH_INFO: `/v3/users/2c2a7955c5a54f04a199554dc0458c53` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:37.255261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] RBAC: Authorizing `identity:get_user(user_id=2c2a7955c5a54f04a199554dc0458c53)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:37.257559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:37.259969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 567/1121] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:37 2022] GET /identity/v3/users/2c2a7955c5a54f04a199554dc0458c53 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:37.268786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:37.370786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303199f4-5e18-46f7-a307-d375ee72d10a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:37.410372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:37.411226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:37.411504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:37.411808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:37.413032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:37.414468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe1fcf-b6ec-4a21-8b94-bf6a11d5c62d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:37.416175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 555/1122] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:37 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:37.422391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:37.534782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884cd3-9a92-47ea-9ff3-02e467728d3b None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:37.569794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:37.570663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:37.570940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:37.571212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a/users/2c2a7955c5a54f04a199554dc0458c53/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:37.573513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] RBAC: Authorizing `identity:create_grant(project_id=27fa7f6366224f29a1ed592cbdc9280a, user_id=2c2a7955c5a54f04a199554dc0458c53, role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:37.574949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145c3a1-f384-4dfb-8c6e-6107d8c6b07a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:37.589489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 568/1123] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:41:37 2022] PUT /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a/users/2c2a7955c5a54f04a199554dc0458c53/roles/3cc7ef3638714f57a89fac869553e946 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:41:39.782719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17dcce-f5a3-4bf3-8fec-7e14bd4b2885 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:39.783284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17dcce-f5a3-4bf3-8fec-7e14bd4b2885 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:39.783284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17dcce-f5a3-4bf3-8fec-7e14bd4b2885 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:39.785391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 556/1124] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:39.794081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:39.794493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:39.794686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:39.812462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:39.813648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:39.906449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 569/1125] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:39.935874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17dcce-f5a3-4bf3-8fec-7e14bd4b2885 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:40.043032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17dcce-f5a3-4bf3-8fec-7e14bd4b2885 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:40.076185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:40.077030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:40.077304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:40.077555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] PATH_INFO: `/v3/roles/3cc7ef3638714f57a89fac869553e946` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:40.079049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] RBAC: Authorizing `identity:get_role(role_id=3cc7ef3638714f57a89fac869553e946)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:40.080450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:40.081808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 557/1126] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:39 2022] GET /identity/v3/roles/3cc7ef3638714f57a89fac869553e946 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:40.088611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:40.205976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21a87b-7a32-478c-bae9-57c884517fdf None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:40.245806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:40.246670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:40.246949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:40.247220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] PATH_INFO: `/v3/users/2c2a7955c5a54f04a199554dc0458c53` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:40.248522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2a7955c5a54f04a199554dc0458c53)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:40.250076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:40.251664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 570/1127] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:40 2022] GET /identity/v3/users/2c2a7955c5a54f04a199554dc0458c53 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:40.257722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:40.354257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbb334-4e1a-457b-be87-f3c8311158d1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:40.388451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:40.389073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:40.389347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:40.389618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:40.454388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:40.455808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:40.554334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 558/1128] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:40.560651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:40.660798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202a401-e61b-428c-a4bd-921fb21fb659 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:40.693642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:40.694481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:40.694757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:40.695025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] PATH_INFO: `/v3/projects/27fa7f6366224f29a1ed592cbdc9280a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:40.696253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=27fa7f6366224f29a1ed592cbdc9280a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:40.697684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d892c7-849c-49a6-a806-310238f44ce7 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:40.699319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 571/1129] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:40 2022] GET /identity/v3/projects/27fa7f6366224f29a1ed592cbdc9280a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:40.708904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:40.809360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c6a46-9d74-48a0-b0b6-d02cb89cb5b7 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:40.842936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:40.843625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:40.843944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:40.844215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:40.845034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] RBAC: Adding query filter params (role.id=3cc7ef3638714f57a89fac869553e946, scope.project.id=27fa7f6366224f29a1ed592cbdc9280a, user.id=2c2a7955c5a54f04a199554dc0458c53) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:40.845341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:40.846764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33730f71-d2e6-47df-808f-ca4c10fe9d4b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:40.852564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 559/1130] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:40 2022] GET /identity/v3/role_assignments?user.id=2c2a7955c5a54f04a199554dc0458c53&scope.project.id=27fa7f6366224f29a1ed592cbdc9280a&role.id=3cc7ef3638714f57a89fac869553e946 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:43.095953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fda78-7ac4-49aa-8f6b-22f25e0657bc None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:43.096531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fda78-7ac4-49aa-8f6b-22f25e0657bc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:43.096531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fda78-7ac4-49aa-8f6b-22f25e0657bc None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:43.098561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 572/1131] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:43.107006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:43.107426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:43.107601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:43.131692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:43.132900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:43.205531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 560/1132] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:43.232558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fda78-7ac4-49aa-8f6b-22f25e0657bc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:43.344300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fda78-7ac4-49aa-8f6b-22f25e0657bc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:43.378474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:43.379174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:43.379455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:43.379728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:43.380942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:43.382372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8b7e-cf34-4fa5-8abc-d34d256cd7cd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:43.384003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 573/1133] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:43.390118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:43.485595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0377de2-a55e-4eb0-85d0-bdb922e1851e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:43.519285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:43.519959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:43.520234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:43.520508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:43.521194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:43.522615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df4b2-7e9c-4ebe-b1cc-0ea79992f8e5 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:43.550024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 561/1134] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:41:43 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:41:45.784925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd04a-3bf2-4a95-89d4-3d7f0528fbae None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:45.785826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd04a-3bf2-4a95-89d4-3d7f0528fbae None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:45.785826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd04a-3bf2-4a95-89d4-3d7f0528fbae None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:45.787892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 574/1135] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:45.796978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:45.797419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:45.797519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:45.827130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:45.828449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:45.898827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 562/1136] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:45.925056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcd04a-3bf2-4a95-89d4-3d7f0528fbae None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:46.035879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcd04a-3bf2-4a95-89d4-3d7f0528fbae None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:46.069511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:46.070273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:46.070546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:46.070807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:46.072167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:46.073593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeadcd-620d-4d3e-bcbe-7abb2c722904 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:46.075198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 575/1137] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:46.081685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:46.183560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12706-a7fd-4005-85c1-4f9236fe6d7f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:46.222063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:46.222731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:46.223003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:46.223271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:46.224018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:46.225447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811516-fe46-4ab2-aa2b-2750fbf847eb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:46.248473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 563/1138] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:41:46 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:41:48.480376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d90-977c-41d7-9a0d-f61ecf830206 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:48.480931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d90-977c-41d7-9a0d-f61ecf830206 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:48.480931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d90-977c-41d7-9a0d-f61ecf830206 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:48.482166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 576/1139] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:48.488630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:48.489699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:48.489837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:48.512134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:48.513307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:48.584457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 564/1140] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:48.617276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31d90-977c-41d7-9a0d-f61ecf830206 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:48.721571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31d90-977c-41d7-9a0d-f61ecf830206 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:48.756510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:48.757211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:48.757487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:48.757751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:48.768212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:48.775617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:48.776776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:48.777803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 577/1141] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:48.782931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:48.883111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5f11-ce72-49aa-920a-34f678fe40c8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:48.916996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:48.917644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:48.917924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:48.918196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:48.918932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:48.919231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:48.920633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:48.928640 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 565/1142] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:48.935114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:49.039708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a14dd-4041-40d4-bf94-5e139ee8a537 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:49.072432 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:49.073276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:49.073550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:49.073819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] PATH_INFO: `/v3/users/2dd2933fa01a45f2b323e00abaf57c6e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:49.086626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] RBAC: Authorizing `identity:get_user(user_id=2dd2933fa01a45f2b323e00abaf57c6e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:49.088073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:49.089675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 578/1143] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:48 2022] GET /identity/v3/users/2dd2933fa01a45f2b323e00abaf57c6e => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:49.099068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:49.224586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c68d0-a5f1-4eeb-9703-4511e336d35e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:49.269145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:49.269820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:49.270142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:49.270414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:49.338173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:49.339546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:49.434414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 566/1144] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:49.440715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:49.545937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e8fa-c53c-4c48-a743-f5fc6614b6fd None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:49.578745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:49.579580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:49.579883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:49.580156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] PATH_INFO: `/v3/projects/6819798280fd4633ad7a7d7db33ac622` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:49.581348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] RBAC: Authorizing `identity:get_project(project_id=6819798280fd4633ad7a7d7db33ac622)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:49.582762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2df2-d692-4d83-8440-96b78482ac4d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:49.584430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 579/1145] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:49 2022] GET /identity/v3/projects/6819798280fd4633ad7a7d7db33ac622 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:49.594220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:49.694072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063ee-c627-4bfe-b827-b350fb936b8f None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:49.728787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:49.729415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:49.729692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:49.729959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:49.730778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=6819798280fd4633ad7a7d7db33ac622, user.id=2dd2933fa01a45f2b323e00abaf57c6e) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:49.731083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:49.732537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affb9a-3991-4b6b-a1aa-d3183c8d3e2b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:49.738503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 567/1146] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:49 2022] GET /identity/v3/role_assignments?user.id=2dd2933fa01a45f2b323e00abaf57c6e&scope.project.id=6819798280fd4633ad7a7d7db33ac622&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:51.899137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2453-0ad8-4a98-8be1-4e2e45854d7c None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:51.899701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2453-0ad8-4a98-8be1-4e2e45854d7c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:51.899701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2453-0ad8-4a98-8be1-4e2e45854d7c None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:51.901087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 580/1147] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:51.907446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:51.908194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:51.908346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:51.930712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:51.931920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:52.033058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 568/1148] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:52.066943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e2453-0ad8-4a98-8be1-4e2e45854d7c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:52.177830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e2453-0ad8-4a98-8be1-4e2e45854d7c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:52.216849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:52.217944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:52.218219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:52.218493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:52.229389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:52.239749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:52.240802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:52.241894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 581/1149] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:52.247470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:52.362951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e08c86-3c50-44d6-8c5b-c77517140801 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:52.396427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:52.397086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:52.397356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:52.397630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:52.398377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:52.398667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:52.400088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:52.407929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 569/1150] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:52.414242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:52.519231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84fa0-f39a-4773-84b1-f6cf0b2b9c97 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:52.556985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:52.557833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:52.558360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:52.558628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] PATH_INFO: `/v3/users/2dd2933fa01a45f2b323e00abaf57c6e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:52.559874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] RBAC: Authorizing `identity:get_user(user_id=2dd2933fa01a45f2b323e00abaf57c6e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:52.561324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:52.562922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 582/1151] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:52 2022] GET /identity/v3/users/2dd2933fa01a45f2b323e00abaf57c6e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:52.569442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:52.700092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6c17-911b-415d-b495-049eaa5d3bfe None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:52.734590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:52.735840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:52.736199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:52.736576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] PATH_INFO: `/v3/projects/6819798280fd4633ad7a7d7db33ac622` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:52.739092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] RBAC: Authorizing `identity:get_project(project_id=6819798280fd4633ad7a7d7db33ac622)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:52.741403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37419ebc-c8d7-470d-acc3-dd6d3cc42699 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:52.744123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 570/1152] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:52 2022] GET /identity/v3/projects/6819798280fd4633ad7a7d7db33ac622 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:52.750094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:52.847354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfac1-8b3a-4e31-b33f-4cafeea9808c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:52.880841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:52.881695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:52.881967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:52.882232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] PATH_INFO: `/v3/projects/6819798280fd4633ad7a7d7db33ac622/users/2dd2933fa01a45f2b323e00abaf57c6e/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:52.884447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] RBAC: Authorizing `identity:create_grant(project_id=6819798280fd4633ad7a7d7db33ac622, user_id=2dd2933fa01a45f2b323e00abaf57c6e, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:52.885870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455c25-5fe7-4510-a8a5-8e10bf385345 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:52.905919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 583/1153] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:41:52 2022] PUT /identity/v3/projects/6819798280fd4633ad7a7d7db33ac622/users/2dd2933fa01a45f2b323e00abaf57c6e/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:41:55.068761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6713a-1650-4e95-9350-42796630612c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.069321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6713a-1650-4e95-9350-42796630612c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.069321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6713a-1650-4e95-9350-42796630612c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.070668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 571/1154] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:55.077061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.077769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.077914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.100462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:55.101623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:55.168004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 584/1155] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:55.191760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6713a-1650-4e95-9350-42796630612c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:55.314746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6713a-1650-4e95-9350-42796630612c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:55.351692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:55.352448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.352730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.353000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.364202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:41:55.371712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:55.372812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:41:55.373811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 572/1156] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:55.379505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:55.480316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be63cc-3cd5-4246-a9b4-e2f6348c45d5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:55.513377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:55.514026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.514347 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.514611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.515338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:55.515638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:55.517025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:55.524908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 585/1157] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:41:55.531460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:55.640461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271242-c1f3-4364-8444-4c158ad035cf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:55.673489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b58f94-3922-483f-8413-60134703200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:55.674340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58f94-3922-483f-8413-60134703200a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.674614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58f94-3922-483f-8413-60134703200a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.674880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58f94-3922-483f-8413-60134703200a None admin] PATH_INFO: `/v3/users/2dd2933fa01a45f2b323e00abaf57c6e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.676214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b58f94-3922-483f-8413-60134703200a None admin] RBAC: Authorizing `identity:get_user(user_id=2dd2933fa01a45f2b323e00abaf57c6e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:55.677641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b58f94-3922-483f-8413-60134703200a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:55.679247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 573/1158] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:41:55 2022] GET /identity/v3/users/2dd2933fa01a45f2b323e00abaf57c6e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:55.685540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:55.785939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e3ae-a377-4000-a0e5-3be17fd67ba1 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:55.820439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:55.821077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:55.821358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:55.821628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:55.889996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:55.891522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:55.999905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 586/1159] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:56.006450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b58f94-3922-483f-8413-60134703200a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:56.112958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b58f94-3922-483f-8413-60134703200a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:56.153314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:56.154114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:56.154394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:56.154655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] PATH_INFO: `/v3/projects/6819798280fd4633ad7a7d7db33ac622` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:56.155975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6819798280fd4633ad7a7d7db33ac622)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:56.157409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6e45e-a6ee-4ca0-a09c-f23c1546a4e3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:56.159127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 574/1160] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:41:56 2022] GET /identity/v3/projects/6819798280fd4633ad7a7d7db33ac622 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:56.168691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:56.280242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b6a9-e7bd-44f9-9528-b1057209d652 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:56.315820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:56.316476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:56.316750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:56.317014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:56.317822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=6819798280fd4633ad7a7d7db33ac622, user.id=2dd2933fa01a45f2b323e00abaf57c6e) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:56.318122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:56.319558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27aff7-157f-4ce1-ab7f-341982170843 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:56.325355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 587/1161] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:41:56 2022] GET /identity/v3/role_assignments?user.id=2dd2933fa01a45f2b323e00abaf57c6e&scope.project.id=6819798280fd4633ad7a7d7db33ac622&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:41:58.536362 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84dd7-cb3b-4517-a197-501d8606bdfb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:58.536888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84dd7-cb3b-4517-a197-501d8606bdfb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:58.536888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84dd7-cb3b-4517-a197-501d8606bdfb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:58.538181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 575/1162] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:41:58.544464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:58.545161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:58.545374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:58.573493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:41:58.575373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:41:58.642058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 588/1163] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:41:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:41:58.675223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f84dd7-cb3b-4517-a197-501d8606bdfb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:58.777840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f84dd7-cb3b-4517-a197-501d8606bdfb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:58.812041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:58.812624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:58.812905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:58.813179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:58.883602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:58.885078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:58.981176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 576/1164] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:41:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:41:58.990816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:59.085308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aad33-4970-465c-945c-3d60f4d29c81 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:59.120398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:59.121176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:59.121459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:59.121720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:59.128165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:59.129586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d4e816a7-d36d-4cc8-91fb-f3d99e99028d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:41:59.143175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:41:59.144370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:41:59.145694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 589/1165] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:41:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:41:59.150464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:41:59.249551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8ee6-7faa-444c-8051-2f2e12cc93be None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:41:59.283082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:41:59.283700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:41:59.284035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:41:59.284297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:41:59.284998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:41:59.285299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:41:59.286650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de4342-b1de-480f-9d6e-e7ff427ded8e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:41:59.297077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 577/1166] 10.222.0.11 () {56 vars in 1115 bytes} [Tue May 3 08:41:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:01.516785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7687d7-28bc-45e4-aa53-650e7d19b640 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:01.517597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7687d7-28bc-45e4-aa53-650e7d19b640 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:01.517597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7687d7-28bc-45e4-aa53-650e7d19b640 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:01.519683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 590/1167] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:01.525032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf66ef-4468-4923-825c-fd57b1411d22 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:01.525452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf66ef-4468-4923-825c-fd57b1411d22 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:01.525572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf66ef-4468-4923-825c-fd57b1411d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:01.543654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-dacf66ef-4468-4923-825c-fd57b1411d22 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:01.544831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dacf66ef-4468-4923-825c-fd57b1411d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:01.611015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 578/1168] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:42:01.633813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7687d7-28bc-45e4-aa53-650e7d19b640 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:01.759793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7687d7-28bc-45e4-aa53-650e7d19b640 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:01.804455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:01.805032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:01.805312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:01.805582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:01.806315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:01.807668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098018b5-114d-4db0-a354-cb84133fd551 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:01.825168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 591/1169] 10.222.0.11 () {60 vars in 1138 bytes} [Tue May 3 08:42:01 2022] POST /identity/v3/domains => generated 267 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:42:04.060142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aca31-8ce4-4194-9d91-8e5827d27467 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:04.062839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aca31-8ce4-4194-9d91-8e5827d27467 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:04.062839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aca31-8ce4-4194-9d91-8e5827d27467 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:04.062839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 579/1170] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:04.068742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e927d-f516-4c16-9958-253335465ba1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:04.069473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e927d-f516-4c16-9958-253335465ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:04.069601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e927d-f516-4c16-9958-253335465ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:04.095640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-339e927d-f516-4c16-9958-253335465ba1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:04.096843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-339e927d-f516-4c16-9958-253335465ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:04.165017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 592/1171] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:42:04.195979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aca31-8ce4-4194-9d91-8e5827d27467 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:04.302031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aca31-8ce4-4194-9d91-8e5827d27467 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:04.335395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:04.336199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:04.336471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:04.336739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] PATH_INFO: `/v3/domains/3303646b488b4d90802e16db7cbb2334` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:04.347122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=3303646b488b4d90802e16db7cbb2334)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:04.348583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8363fd0-7828-4f80-928d-9a30771d5a6a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:04.350190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 580/1172] 10.222.0.11 () {56 vars in 1183 bytes} [Tue May 3 08:42:04 2022] GET /identity/v3/domains/3303646b488b4d90802e16db7cbb2334 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:04.356465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e927d-f516-4c16-9958-253335465ba1 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:04.454977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e927d-f516-4c16-9958-253335465ba1 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:04.489721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:04.490359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:04.490637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:04.490905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:04.491619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:04.493109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454ca0-fe59-4ecb-83bb-5363f589a24c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:04.523612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 593/1173] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:42:04 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:42:06.761756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2e82-f368-4e70-9bf2-5f0cf6c53903 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:06.762659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2e82-f368-4e70-9bf2-5f0cf6c53903 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:06.762659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2e82-f368-4e70-9bf2-5f0cf6c53903 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:06.764950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 581/1174] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:06.772892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:06.773369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:06.773484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:06.791687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:06.792874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:06.857636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 594/1175] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:42:06.894428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a2e82-f368-4e70-9bf2-5f0cf6c53903 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:06.994489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a2e82-f368-4e70-9bf2-5f0cf6c53903 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:07.027474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:07.028303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:07.028577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:07.028835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] PATH_INFO: `/v3/domains/3303646b488b4d90802e16db7cbb2334` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:07.030067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3303646b488b4d90802e16db7cbb2334)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:07.031489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155b91-f6f1-447d-970e-331d5fc26fc8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:07.033145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 582/1176] 10.222.0.11 () {56 vars in 1183 bytes} [Tue May 3 08:42:06 2022] GET /identity/v3/domains/3303646b488b4d90802e16db7cbb2334 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:07.039189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:07.141641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa17adf-dd37-4426-8fba-c2e58c926d27 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:07.175330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:07.175992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:07.176270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:07.176542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:07.177223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:07.178644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955efade-0ea0-462d-bc7d-0a1c8a4b55d9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:07.201495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 595/1177] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:42:07 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:42:09.445980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08fa-12e9-4451-b89b-76eea329ee9d None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:09.446874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08fa-12e9-4451-b89b-76eea329ee9d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:09.446874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08fa-12e9-4451-b89b-76eea329ee9d None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:09.449084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 583/1178] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:09.454655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:09.455099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:09.455204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:09.473110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:09.474190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:09.539668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 596/1179] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:42:09.562662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba08fa-12e9-4451-b89b-76eea329ee9d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:09.665070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba08fa-12e9-4451-b89b-76eea329ee9d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:09.698728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:09.699501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:09.699814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:09.700080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:09.710437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:42:09.718031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:42:09.719189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:42:09.720914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 584/1180] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:42:09.729236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:09.832410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1389-2fc3-4230-ab1b-b5d1c5cb3126 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:09.866851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:09.867498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:09.867806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:09.868081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:09.868821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:42:09.869121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:09.870493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:09.878440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 597/1181] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:09.887824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:09.997789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bfb8-2446-4124-99d2-0f33286bb341 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:10.033863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:10.034718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:10.034997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:10.035272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] PATH_INFO: `/v3/users/c5b1e50f5d3e4001b8b7890138861ffd` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:10.048486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=c5b1e50f5d3e4001b8b7890138861ffd)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:10.049936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:10.051559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 585/1182] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:42:09 2022] GET /identity/v3/users/c5b1e50f5d3e4001b8b7890138861ffd => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:10.057434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:10.172723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7292d9-07ea-4626-9d9d-da5361a89317 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:10.218124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:10.218770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:10.219046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:10.219322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:10.297081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:10.298451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:10.393703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 598/1183] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:42:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:42:10.399791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:10.497985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7ba-3f90-4541-8fc9-7b164a40f2d6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:10.531379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:10.532245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:10.532517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:10.532786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] PATH_INFO: `/v3/projects/0a74620dc6584f54b9062c12589cc644` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:10.534074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a74620dc6584f54b9062c12589cc644)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:10.535489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e673-2109-4c49-b1de-c1f1dde86ab4 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:10.537177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 586/1184] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:42:10 2022] GET /identity/v3/projects/0a74620dc6584f54b9062c12589cc644 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:10.543288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:10.647525 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2a90-8ab9-4ed8-9d3d-da739a266c1c None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:10.681157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:10.681787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:10.682064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:10.682331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:10.683149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=0a74620dc6584f54b9062c12589cc644, user.id=c5b1e50f5d3e4001b8b7890138861ffd) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:42:10.683455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:10.684892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2b400-aa82-47b2-b742-d258ab0847db None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:10.690325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 599/1185] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:42:10 2022] GET /identity/v3/role_assignments?user.id=c5b1e50f5d3e4001b8b7890138861ffd&scope.project.id=0a74620dc6584f54b9062c12589cc644&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:12.867545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8201-cb3a-4497-abcb-a5ff95dcc1af None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:12.868455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8201-cb3a-4497-abcb-a5ff95dcc1af None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:12.868455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8201-cb3a-4497-abcb-a5ff95dcc1af None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:12.870607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 587/1186] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:12.878690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:12.879127 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:12.879238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:12.897071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:12.898219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:12.969214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 600/1187] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:42:13.003521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8201-cb3a-4497-abcb-a5ff95dcc1af None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:13.106203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8201-cb3a-4497-abcb-a5ff95dcc1af None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:13.140195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:13.140973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:13.141250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:13.141517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:13.152013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:42:13.159516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:42:13.160627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:42:13.161879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 588/1188] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:42:13.170228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:13.275924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58c554-71b0-476e-93b7-1c869ae48d8f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:13.309472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:13.310198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:13.310467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:13.310733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:13.311467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:42:13.311788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:13.313150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:13.321071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 601/1189] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:13.327333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:13.433751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70a9e-c461-4675-a007-73ef7dfa9846 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:13.468873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:13.469788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:13.470076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:13.470332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] PATH_INFO: `/v3/users/c5b1e50f5d3e4001b8b7890138861ffd` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:13.471595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] RBAC: Authorizing `identity:get_user(user_id=c5b1e50f5d3e4001b8b7890138861ffd)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:13.473054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:13.474673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 589/1190] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:42:13 2022] GET /identity/v3/users/c5b1e50f5d3e4001b8b7890138861ffd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:13.483388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:13.584075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64789-c438-48aa-91bf-0c7452b244f6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:13.620385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:13.621227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:13.621505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:13.621775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] PATH_INFO: `/v3/projects/0a74620dc6584f54b9062c12589cc644` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:13.623053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] RBAC: Authorizing `identity:get_project(project_id=0a74620dc6584f54b9062c12589cc644)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:13.624513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe80549-f6cd-40c7-8041-3049c381657e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:13.626190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 602/1191] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:42:13 2022] GET /identity/v3/projects/0a74620dc6584f54b9062c12589cc644 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:13.632836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:13.742996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbec-dec6-4559-bb02-88d456c76c81 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:13.776082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:13.776962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:13.777239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:13.777509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] PATH_INFO: `/v3/projects/0a74620dc6584f54b9062c12589cc644/users/c5b1e50f5d3e4001b8b7890138861ffd/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:13.779816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a74620dc6584f54b9062c12589cc644, user_id=c5b1e50f5d3e4001b8b7890138861ffd, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:13.781257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cab52-73d6-4050-b63e-7095b1689006 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:13.797015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 590/1192] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:42:13 2022] PUT /identity/v3/projects/0a74620dc6584f54b9062c12589cc644/users/c5b1e50f5d3e4001b8b7890138861ffd/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:42:15.996522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c97a1-3db8-4feb-b44a-8c82f3904ad1 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:15.997187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c97a1-3db8-4feb-b44a-8c82f3904ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:15.997187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c97a1-3db8-4feb-b44a-8c82f3904ad1 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:15.998490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 603/1193] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:42:16.003941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:16.004363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:16.004472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:16.022893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:42:16.024129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:42:16.091017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 591/1194] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:42:16.114871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c97a1-3db8-4feb-b44a-8c82f3904ad1 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:16.230220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c97a1-3db8-4feb-b44a-8c82f3904ad1 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:16.284022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:16.284741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:16.285023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:16.285295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:16.297050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:42:16.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:42:16.305663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:42:16.306666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 604/1195] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:42:16.311955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:16.411223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fe659-8cb4-4491-812b-7d91b6cf8c3e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:16.444832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:16.445482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:16.445758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:16.446025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:16.446758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:42:16.447057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:16.448453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:16.456460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 592/1196] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:16.462986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:16.571101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0891f1-c1d1-4931-b94e-c819e2593419 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:16.605079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:16.605925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:16.606202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:16.606499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] PATH_INFO: `/v3/users/c5b1e50f5d3e4001b8b7890138861ffd` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:16.607816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] RBAC: Authorizing `identity:get_user(user_id=c5b1e50f5d3e4001b8b7890138861ffd)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:16.609267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:16.610862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 605/1197] 10.222.0.11 () {56 vars in 1177 bytes} [Tue May 3 08:42:16 2022] GET /identity/v3/users/c5b1e50f5d3e4001b8b7890138861ffd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:16.620435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:16.729584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212489b-e8d7-43b5-86f9-e51b94d61066 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:16.770813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:16.771477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:16.771785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:16.772070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:16.838091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:16.839466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:16.934088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 593/1198] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:42:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:42:16.943012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:17.042136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c6933-875c-48d7-8303-22732b186bdf None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:17.075937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:17.076771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:17.077057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:17.077316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] PATH_INFO: `/v3/projects/0a74620dc6584f54b9062c12589cc644` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:17.078592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] RBAC: Authorizing `identity:get_project(project_id=0a74620dc6584f54b9062c12589cc644)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:17.080107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ebc84-aeb0-42f1-b647-45680dae7b0b None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:17.081854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 606/1199] 10.222.0.11 () {56 vars in 1186 bytes} [Tue May 3 08:42:16 2022] GET /identity/v3/projects/0a74620dc6584f54b9062c12589cc644 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:42:17.088863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:42:17.199230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c9ab-6f81-49eb-a2f4-e476e824e924 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:42:17.233747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:42:17.234390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:42:17.234662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:42:17.234924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:42:17.235742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=0a74620dc6584f54b9062c12589cc644, user.id=c5b1e50f5d3e4001b8b7890138861ffd) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:42:17.236082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:42:17.237807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476d211-71f9-4d13-bd01-7fa585986059 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:42:17.243409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 594/1200] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:42:17 2022] GET /identity/v3/role_assignments?user.id=c5b1e50f5d3e4001b8b7890138861ffd&scope.project.id=0a74620dc6584f54b9062c12589cc644&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:18.198627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58de77-97e3-490d-9ade-6dd14e0f28b2 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:18.199239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58de77-97e3-490d-9ade-6dd14e0f28b2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:18.199239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58de77-97e3-490d-9ade-6dd14e0f28b2 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:18.202188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 607/1201] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:18.210046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:18.210587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:18.210676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:18.232654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:18.233843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:18.305344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 595/1202] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:18.333306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58de77-97e3-490d-9ade-6dd14e0f28b2 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:18.438230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58de77-97e3-490d-9ade-6dd14e0f28b2 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:18.474807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:18.475502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:18.475846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:18.476085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:18.486996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:18.488489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:18.506664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:18.507725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:18.508779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:18.508779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:18.508779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:18.508779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:18.508779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 608/1203] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:18.518393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:18.631971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533f9fa-271c-473c-a7cc-cf28ffbb2e30 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:18.680075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:18.680742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:18.681260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:18.681545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:18.682675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:18.682990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:18.685076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873db02-d40e-4a96-885b-636d566c8e5f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:18.708837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 596/1204] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:18.712535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:18.833600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8881c8-59fa-4463-bc7b-5e63f21a39b6 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:18.880400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:18.881394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:18.881817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:18.882238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:18.883099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:18.884769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d59b1c-81bd-4306-8e1e-6ef2ca191fa6 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:18.907442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 609/1205] 10.222.0.11 () {60 vars in 1132 bytes} [Tue May 3 08:43:18 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:43:21.469893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91dcb-125c-484e-bb8d-68377e339e8c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:21.470417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91dcb-125c-484e-bb8d-68377e339e8c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:21.470417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91dcb-125c-484e-bb8d-68377e339e8c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:21.472097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 597/1206] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:21.477435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:21.478581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:21.478581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:21.498063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:21.500106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:21.576740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 610/1207] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:21.602722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91dcb-125c-484e-bb8d-68377e339e8c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:21.724510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91dcb-125c-484e-bb8d-68377e339e8c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:21.762758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:21.763679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:21.764016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:21.764315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:21.775550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:21.783607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:21.784630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:21.785498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 598/1208] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:21.791437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:21.903337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a3a1c-5ed6-46c3-9771-fe3bfee74d04 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:21.940974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:21.942317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:21.942317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:21.942317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:21.943028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:21.943327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:21.944898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:21.953320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 611/1209] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:21.960173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:22.071424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f605fd-804a-4c80-9d88-065526344f17 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:22.107402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:22.108761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:22.108887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:22.109097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:22.122549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:22.124067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:22.142458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:22.143454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:22.144419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:22.144419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:22.144419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:22.144419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:22.145389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 599/1210] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:22.152264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:22.260268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125efe3-1ffa-480e-a98d-ef6d8807e1d5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:22.295394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:22.296075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:22.296349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:22.296623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:22.297435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:22.297688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:22.299063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:22.317487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 612/1211] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:22.319018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:22.423188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502357-27a0-4c93-b9aa-5b1414c99268 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:22.458684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:22.459531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:22.459836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:22.460111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:22.468851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:22.470250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:22.485444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:22.486529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:22.493150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 600/1212] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:43:22.494164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:22.597277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9225d-fa9d-4461-a3c9-9c6910c28286 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:22.631704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:22.632459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:22.632745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:22.633057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:22.633974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:22.634273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:22.635681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:22.654003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 613/1213] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:22.660554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:22.780121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951bc7-faec-48e7-97dd-5c2758e75c9c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:22.816322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:22.817094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:22.817341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:22.817693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:22.889265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:22.891080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.001499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 601/1214] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:43:23.009195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:23.108215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906fbf6-a8d4-498f-bfa9-1f5fc57928d4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:23.143150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:23.144047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:23.144422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:23.144544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:23.155128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:23.157023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:23.174183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:23.175399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:23.176531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:23.176531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:23.176531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:23.176531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:23.181138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:23.183087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 614/1215] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:43:23.285775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0d6ab-a0e7-4396-a9d0-0bc17ae83846 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:23.320736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:23.321399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:23.321678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:23.321947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:23.322662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:23.322964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:23.324368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.335792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 602/1216] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:23.341629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:23.442188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a6fb-4fd9-4471-b14d-9bbaff5b7b32 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:23.477822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:23.478683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:23.478872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:23.479173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:23.486338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:23.487793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:23.501580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:23.503151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:23.504284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:23.508748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:23.509385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 615/1217] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:23.610970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f2c-c6bc-496c-9bf7-bf5a7b8306cc None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:23.645413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:23.646110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:23.646371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:23.646613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:23.647392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:23.647692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:23.649234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eca85f-897b-4c12-ac6a-ca2707d5d0c8 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.660956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 603/1218] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:23.667254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:23.779314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7e88-4ab1-4e5a-926e-253422f99b8d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:23.819059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:23.819758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:23.820071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:23.820431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:23.821371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=020655763b4c4606b1664ad43f047264) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:23.821672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:23.823190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f7ba8-2a62-40f5-9cbd-b55734583161 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:23.829617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 616/1219] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:43:23 2022] GET /identity/v3/role_assignments?user.id=020655763b4c4606b1664ad43f047264&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:26.059155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45861ce-92d6-4cd7-900f-2f9739d42c6a None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.059735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45861ce-92d6-4cd7-900f-2f9739d42c6a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.059735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45861ce-92d6-4cd7-900f-2f9739d42c6a None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.061096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 604/1220] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:26.067195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.067629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.067805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.085705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:26.086917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:26.153993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 617/1221] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:26.177105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45861ce-92d6-4cd7-900f-2f9739d42c6a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:26.280518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45861ce-92d6-4cd7-900f-2f9739d42c6a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:26.314797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:26.315533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.315841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.316114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.327055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:26.334750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:26.335993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:26.336982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 605/1222] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:26.342381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:26.447939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab3f8-ce81-4fa0-b72a-6bac93c242ff None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:26.484683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:26.485402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.485722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.485994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.486821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:26.487155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:26.488595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:26.497343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 618/1223] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:26.503813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:26.609013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f55b5-0945-4615-a27d-78ae039474d9 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:26.644013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:26.644820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.645088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.645374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.656066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:26.657499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:26.675298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:26.676422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:26.677463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:26.677463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:26.677463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:26.677463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:26.677463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 606/1224] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:26.682566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:26.792286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045676d-1e00-410d-a76c-3daafcfe3ab3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:26.831745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:26.832426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:26.832788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:26.833008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:26.833773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:26.834071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:26.835527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:26.847404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 619/1225] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:26.853539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:26.963264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff6bf-d1de-487d-b6ec-9e3a713a9970 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.008093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.008904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.009269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.009485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.019709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.021444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:27.038405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:27.040299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:27.041767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 607/1226] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:27.045821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:27.152569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801fc53-24da-4f80-ad3c-8fb198dacc92 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.192626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.193444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.193728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.194080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.195129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:27.195573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.197175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.219225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 620/1227] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:27.225172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:27.325847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040e92-b875-4c88-b91f-e130d296828b None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.361769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.362558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.362934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.363185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.375435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.376980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:27.394357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:27.395564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:27.396714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:27.396714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:27.396714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:27.396714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:27.396714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 608/1228] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:27.402120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:27.515447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09341e-7678-4ec9-bc8c-9de76074a891 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.551545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.552236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.552509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.552775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.553475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:27.553811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.555292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.567035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 621/1229] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:27.573958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:27.676848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b7ae-f033-4fa4-a008-d714f79a3894 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.710677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.711684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.711852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.712107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.719083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.720540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:27.736108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:27.737906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:27.739308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 609/1230] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:27.743743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:27.843467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02804a5e-c0c7-4494-ab55-011d91060d41 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:27.881470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:27.882258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:27.882673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:27.883077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:27.884041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:27.884429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:27.886060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fd4f-24f3-49ac-ad95-77b276997468 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:27.898005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 622/1231] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:27.904277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:28.003534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1867-5048-42f8-9727-66ae37d36d3a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:28.037546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:28.038521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:28.038799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:28.039098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/020655763b4c4606b1664ad43f047264/roles/e34ccfc0e2844bf1ab4712719955ceca` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:28.053734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=020655763b4c4606b1664ad43f047264, role_id=e34ccfc0e2844bf1ab4712719955ceca)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:28.055235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77831-d6f9-42ea-9f31-6236b67d64db None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:28.067931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 610/1232] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:43:27 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/020655763b4c4606b1664ad43f047264/roles/e34ccfc0e2844bf1ab4712719955ceca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:43:30.273335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d063f-fd56-446a-993f-7feeb0a0518e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:30.273891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d063f-fd56-446a-993f-7feeb0a0518e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:30.273891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d063f-fd56-446a-993f-7feeb0a0518e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:30.275234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 623/1233] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:30.280646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:30.281239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:30.281239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:30.297805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:30.298977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:30.378804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 611/1234] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:30.406100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d063f-fd56-446a-993f-7feeb0a0518e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:30.511602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d063f-fd56-446a-993f-7feeb0a0518e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:30.545581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:30.546308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:30.546585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:30.546854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:30.557586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:30.566066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:30.567335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:43:30.568371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:30.573089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 624/1235] 10.222.0.11 () {56 vars in 1102 bytes} [Tue May 3 08:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:30.574166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:30.675246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa9085-1fb1-417a-bfa7-36f187428242 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:30.712744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:30.713409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:30.713691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:30.713957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:30.714696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:30.714994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:30.716596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:30.725869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 612/1236] 10.222.0.11 () {56 vars in 1103 bytes} [Tue May 3 08:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:30.732428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:30.851440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44883-9829-49f2-89ad-4e35a9af40ec None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:30.889137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:30.889948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:30.890226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:30.890496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:30.901063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:30.902655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:30.919913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:30.920989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:30.921891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:30.921891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:30.921891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:30.921891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:30.921891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 625/1237] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:30.928474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:31.037433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9817c-8001-4c8c-9e0b-b968e1f266a6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:31.076833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:31.077659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:31.079076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:31.079423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:31.080390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:31.080789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:31.082349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:31.096463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 613/1238] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:31.102471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:31.216405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1f4d-5bcb-4763-a1ef-0ea35cc0b58d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:31.254023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:31.254897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:31.255280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:31.255622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:31.264936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:31.266912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:31.282494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:31.288551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:31.289749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 626/1239] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:43:31.290460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:31.405257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594080c6-64f1-4da3-918c-f0292320adae None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:31.444979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:31.445649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:31.445922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:31.446187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:31.447058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:31.447394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:31.449154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:31.471208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 614/1240] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:31.479609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:31.588905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d156-b5d9-4389-a2bf-42d4de2abca3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:31.623514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:31.624289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:31.624572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:31.624869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:31.701958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:31.703387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:31.815860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 627/1241] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:43:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:43:31.821849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:31.928062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615137a-3919-47cf-857b-4ee372f8b3ee None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:31.964175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:31.964833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:31.965135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:31.965385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:31.975969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:31.977409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:31.995149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:31.996780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:31.998017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:31.998017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:31.998017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:31.998017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:31.998017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 615/1242] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:32.002382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:32.108002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f017f8-5f87-47ba-ba94-3a01ac299356 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:32.141740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:32.142442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:32.142684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:32.142965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:32.143690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:32.144005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:32.145374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:32.156371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 628/1243] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:32.162057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:32.268028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6b98e-6b1d-49e6-a2a7-cefc15637b03 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:32.304394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:32.305291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:32.305626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:32.305959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:32.312945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:32.314432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:32.328391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:32.329483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:32.330431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 616/1244] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:32.335875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:32.449506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe631c-f57c-4a3e-9af7-08d17f519b4e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:32.484972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:32.485633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:32.485911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:32.486189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:32.486965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:32.487263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:32.488727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652661b-7701-4017-aa91-75401f35e6f2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:32.500897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 629/1245] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:32.507001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:32.605880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb721-74ad-4b0f-bbd5-c3e7d9921ab3 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:32.638509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:32.639217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:32.639541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:32.639864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:32.640682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] RBAC: Adding query filter params (role.id=e34ccfc0e2844bf1ab4712719955ceca, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=020655763b4c4606b1664ad43f047264) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:32.640988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:32.642486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c56d1-0fcf-4cb6-a012-2989a5ca2045 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:32.648995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 617/1246] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:43:32 2022] GET /identity/v3/role_assignments?user.id=020655763b4c4606b1664ad43f047264&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=e34ccfc0e2844bf1ab4712719955ceca => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:35.001322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7aa10-6a12-4912-b57b-a5081099e0a3 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.001910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7aa10-6a12-4912-b57b-a5081099e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.001910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7aa10-6a12-4912-b57b-a5081099e0a3 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.003253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 630/1247] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:35.008720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.009264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.009264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.028566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:35.029819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:35.109644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 618/1248] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:35.134720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7aa10-6a12-4912-b57b-a5081099e0a3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:35.260570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7aa10-6a12-4912-b57b-a5081099e0a3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:35.296980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:35.297893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.298169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.298435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.310392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:35.318346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:35.319532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:35.320739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:35.325167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 631/1249] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:35.326165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:35.426638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520b7-41c3-417a-a0f0-8afc26d026b4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:35.464783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:35.465456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.465729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.466083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.466837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:35.467113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:35.468554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:35.481832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 619/1250] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:35.482917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:35.584001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5205-0dfb-4e6a-b98b-757c084eb26a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:35.618560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:35.619734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.620064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.620503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.632213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:35.633895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:35.652198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:35.653335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:35.654429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:35.654429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:35.654429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:35.654429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:35.654429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 632/1251] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:35.659168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:35.765224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d9bc-746b-466d-9b2a-245d100e484c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:35.802535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:35.803195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.803468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.803740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.804645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:35.804957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:35.806302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:35.818012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 620/1252] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:35.824102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:35.935038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad863ce-0924-48b5-9469-340aa6dfea5d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:35.973716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:35.974516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:35.974791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:35.975053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:35.982740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:35.984586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:36.000856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:36.002518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:36.003744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 633/1253] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:36.008411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:36.123037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba637b-c2db-4da1-b3fa-2aa7247b4a85 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:36.161689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:36.162375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:36.162656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:36.162932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:36.163850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:36.164164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:36.165736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:36.185650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 621/1254] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:36.192638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:36.309229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b984-1cb3-47ce-80dd-18a03a997559 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:36.349417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:36.350060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:36.350339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:36.350706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:36.427561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:36.429208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:36.535213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 634/1255] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:43:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:43:36.541011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:36.639863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208671c8-ad63-4e6b-8e91-c41a8dd09983 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:36.674468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:36.675315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:36.675607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:36.675928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:36.687378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:36.688979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:36.710243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:36.711275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:36.717278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:36.717278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:36.717278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:36.717278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:36.717278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 622/1256] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:36.719560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:36.828152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330745-1ff2-4546-85cb-04ddd33d3a29 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:36.861195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:36.861859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:36.862132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:36.862396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:36.863108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:36.863405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:36.864822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:36.877157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 635/1257] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:36.883175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:36.990877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c14c-e6d8-480f-8c1d-ca3b5b1356e6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:37.025945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:37.026752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:37.027033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:37.027284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:37.034568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:37.036065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:37.050300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:37.051445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:37.052912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 623/1258] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:37.057758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:37.159558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580358-7985-4947-8ea2-278377b4c678 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:37.192711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:37.193363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:37.193635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:37.193899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:37.194750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:37.194966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:37.196472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf7269-8b06-43ff-a55b-4c381f30c3e2 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:37.209020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 636/1259] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:37.215376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:37.311562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e51e-5b58-479a-acee-025ba1b628bf None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:37.345378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:37.346028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:37.346306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:37.346576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:37.347417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=020655763b4c4606b1664ad43f047264) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:37.347716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:37.349150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4b4b9-7c86-461a-a04b-6863a08d517f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:37.354478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 624/1260] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:43:37 2022] GET /identity/v3/role_assignments?user.id=020655763b4c4606b1664ad43f047264&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:39.509258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2951cc-ed4e-48ec-9c72-8ea3a7f164ed None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:39.509785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2951cc-ed4e-48ec-9c72-8ea3a7f164ed None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:39.509785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2951cc-ed4e-48ec-9c72-8ea3a7f164ed None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:39.511067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 637/1261] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:39.517290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:39.517971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:39.518156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:39.538687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:39.539894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:39.609288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 625/1262] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:39.631790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2951cc-ed4e-48ec-9c72-8ea3a7f164ed None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:39.755217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2951cc-ed4e-48ec-9c72-8ea3a7f164ed None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:39.793646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:39.794446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:39.794722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:39.794991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:39.804488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:39.812073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:39.813068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:39.813945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 638/1263] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:39.819908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:39.929148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8c7d-6d7e-49cf-aec8-e58671e76db3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:39.973521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:39.974185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:39.974463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:39.974737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:39.975475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:39.976501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:39.977175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:39.985939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 626/1264] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:39.991968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.084874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f1-140a-4629-9747-dc0ce7d90d0e None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:40.118272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:40.119032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:40.119304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:40.119570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:40.130093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:40.131522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:40.153277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:40.154340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:40.155446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:40.155446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:40.155446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:40.155446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:40.155446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 639/1265] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:40.163809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.273524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828f8a-f284-45c5-80df-d83c3b303b6c None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:40.309551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:40.310249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:40.310557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:40.310845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:40.311645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:40.311970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:40.313550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:40.326152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 627/1266] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:40.334772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.437774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a15a7-0b68-4249-a15a-caa16c86c92d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:40.475935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:40.476718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:40.476991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:40.477258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:40.484880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:40.486296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:40.500275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:40.501336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:40.502449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 640/1267] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:40.509442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.617065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291e61-5632-4aca-a66d-97d4d965f6f1 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:40.652984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:40.653635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:40.653908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:40.654176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:40.654995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:40.655297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:40.656749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:40.673953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 628/1268] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:40.680422 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.814855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed27cb-0f88-4a4e-b1d9-588550be4703 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:40.851504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:40.852317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:40.852596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:40.852870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:40.864653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:40.866090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:40.882881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:40.883974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:40.884893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:40.884893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:40.884893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:40.884893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:40.884893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 641/1269] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:40.889913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:40.987802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3fa2-8853-48f7-ab98-addc5fd2f2ce None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:41.021426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:41.022073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:41.022394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:41.022664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:41.023368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:41.023666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:41.025064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:41.035976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 629/1270] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:41.041705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:41.151103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca74e7-f0a5-4d14-be80-7b17d3caf19d None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:41.185610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:41.186386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:41.186664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:41.186936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:41.193730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:41.195270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:41.209399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:41.210358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:41.212075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 642/1271] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:41.218820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:41.317250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525859-3388-4680-bf64-625cd5ab423d None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:41.350076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:41.350765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:41.351044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:41.351314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:41.352117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:41.352421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:41.353846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecda4-f4d6-4a8d-9662-40aa7dd05061 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:41.365799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 630/1272] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:41.371967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:41.471380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678de815-b3ce-4a96-a0f2-898e1ab40ed4 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:41.503957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:41.504828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:41.505107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:41.505378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] PATH_INFO: `/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/020655763b4c4606b1664ad43f047264/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:41.507592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba5fb65c5b74666b911151d531b1a2d, user_id=020655763b4c4606b1664ad43f047264, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:41.509065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061ff6-763a-4ec0-8ea4-810c5b7bb0a9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:41.525631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 643/1273] 10.222.0.11 () {58 vars in 1439 bytes} [Tue May 3 08:43:41 2022] PUT /identity/v3/projects/aba5fb65c5b74666b911151d531b1a2d/users/020655763b4c4606b1664ad43f047264/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:43:43.729530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4deb-f69d-4fd2-a042-51bd5c61f4f3 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:43.730370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4deb-f69d-4fd2-a042-51bd5c61f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:43.730370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4deb-f69d-4fd2-a042-51bd5c61f4f3 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:43.732353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 631/1274] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:43:43.740298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:43.740735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:43.740888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:43.761420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:43.762593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:43.838019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 644/1275] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:43.861519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4deb-f69d-4fd2-a042-51bd5c61f4f3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:43.970317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4deb-f69d-4fd2-a042-51bd5c61f4f3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.008576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.009284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.009563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.009827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.023801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:43:44.031304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:44.032386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:44.033518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 632/1276] 10.222.0.11 () {56 vars in 1096 bytes} [Tue May 3 08:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:44.041205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.148072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff81e-af71-4c89-be73-410b20acd8e4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.181619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.182265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.182541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.182805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.183547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:44.183871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:44.185232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:44.193108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 645/1277] 10.222.0.11 () {56 vars in 1099 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:44.199648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.306906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892089c-32b1-4e40-961b-f29f4d7335d6 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.342693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.343457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.343731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.344029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.354754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:44.356232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:44.372994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:44.373999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:44.374949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:44.374949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:44.374949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:44.374949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:44.374949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 633/1278] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:44.380194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.489359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5746-e301-4ea6-a278-1f7d05bd2848 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.522902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.523542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.523868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.524144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.524853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:44.525152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:44.526508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:44.537895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 646/1279] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:44.546715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.653285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea316-5261-43e4-8a0e-a1ad7f829528 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.686074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.686853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.687124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.687393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.694555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:44.696011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:43:44.709799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:44.710994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:44.712454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 634/1280] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:44.717484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.824384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e79db-b903-4019-8e94-ae8dfb4b22b5 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:44.857258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:44.857907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:44.858182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:44.858745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:44.859558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:44.859882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:44.861303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:44.877415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 647/1281] 10.222.0.11 () {56 vars in 1143 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:44.883291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:44.984219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742252-e330-41ef-adeb-8e736a449d9a None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.017155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.017772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.018043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.018307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.082840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.084300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:45.178409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 635/1282] 10.222.0.11 () {58 vars in 1282 bytes} [Tue May 3 08:43:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:43:45.185052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:45.290028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f813eb-1967-488d-b6ae-20af8a997c4a None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.324756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.325526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.325801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.326070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.336155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.337571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:43:45.354572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:45.355674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:45.356766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:43:45.356766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:43:45.356766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:43:45.356766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:45.356766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 648/1283] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:45.363664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:45.462096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1877-a7a4-4260-b9d6-b5c934164e0e None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.495974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.496598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.496868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.497135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.497844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:45.498140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.499494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:45.510386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 636/1284] 10.222.0.11 () {56 vars in 1109 bytes} [Tue May 3 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:43:45.516810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:45.625066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cebab-876d-4e9a-8ac9-a7092e818ce9 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.661081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.661912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.662215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.662500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.669839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.671346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:43:45.685823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application with Lock( May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:45.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: ERROR keystone.server.flask.application May 03 08:43:45.687896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 649/1285] 10.222.0.11 () {56 vars in 1111 bytes} [Tue May 3 08:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:45.693692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:45.796395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99370820-6066-4f1a-ab12-f20428a8ff33 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.830946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.831647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.831987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.832287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.833097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:45.833427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.834930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9a487-805c-4199-8c4f-6dd1bec3abeb None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:45.846959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 637/1286] 10.222.0.11 () {56 vars in 1148 bytes} [Tue May 3 08:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:45.853915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:45.961520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bba5a-4ebd-45fd-a56d-8b33bc976cb3 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:45.994815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:45.995436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:45.995709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:45.996005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:45.996835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] RBAC: Adding query filter params (role.id=40264f46cb744114a960ef46085a53c3, scope.project.id=aba5fb65c5b74666b911151d531b1a2d, user.id=020655763b4c4606b1664ad43f047264) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:45.997136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:45.998647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33183bc2-ce0c-461a-872f-1b82e7450ef3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:46.004455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 650/1287] 10.222.0.11 () {56 vars in 1374 bytes} [Tue May 3 08:43:45 2022] GET /identity/v3/role_assignments?user.id=020655763b4c4606b1664ad43f047264&scope.project.id=aba5fb65c5b74666b911151d531b1a2d&role.id=40264f46cb744114a960ef46085a53c3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:48.204785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbcf9-a811-42a7-b235-d61487f0b7fc None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:48.205669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbcf9-a811-42a7-b235-d61487f0b7fc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:48.205669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbcf9-a811-42a7-b235-d61487f0b7fc None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:48.207134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 638/1288] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:48.213126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:48.213563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:48.213661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:48.230370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:48.231523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:48.296878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 651/1289] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:43:48.319248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bbcf9-a811-42a7-b235-d61487f0b7fc None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:48.425575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bbcf9-a811-42a7-b235-d61487f0b7fc None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:48.459688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:48.460435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:48.460715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:48.460986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:48.461628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:48.462989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:48.474936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:48.476142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:48.477378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 639/1290] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:43:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:48.482186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:48.588155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21018-9b40-4e7a-bda4-936674d38f8c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:48.621719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:48.622368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:48.622647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:48.622920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:48.623617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:48.623953 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:48.625314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aba18-b77d-46ff-a4b2-57f48f0d11a3 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:48.630144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 652/1291] 10.222.0.11 () {56 vars in 1116 bytes} [Tue May 3 08:43:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:48.636722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:48.753108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd69-b394-4bff-a8fc-5097671c8655 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:48.794026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:48.794683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:48.794961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:48.795265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] PATH_INFO: `/v3/services` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:48.796013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:48.796313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:48.797685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d893bb9-c606-4f9f-9576-71d24db77554 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:48.801936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 640/1292] 10.222.0.11 () {56 vars in 1116 bytes} [Tue May 3 08:43:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:50.973449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9af53-5e91-4bc5-a17d-c4a7473e4fd3 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:50.974291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9af53-5e91-4bc5-a17d-c4a7473e4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:50.974291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9af53-5e91-4bc5-a17d-c4a7473e4fd3 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:50.975996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 653/1293] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:50.982287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6774a-a1c5-4cea-8223-c76b2cf3960b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:50.982721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6774a-a1c5-4cea-8223-c76b2cf3960b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:50.982853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6774a-a1c5-4cea-8223-c76b2cf3960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:51.008813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-0ef6774a-a1c5-4cea-8223-c76b2cf3960b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:51.009974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0ef6774a-a1c5-4cea-8223-c76b2cf3960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:51.076671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 641/1294] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:51.108736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9af53-5e91-4bc5-a17d-c4a7473e4fd3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:51.210082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9af53-5e91-4bc5-a17d-c4a7473e4fd3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:51.243167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:51.243749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:51.244054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:51.244320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:51.245023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:51.246372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bea044-85fc-4cae-8954-0413b2e1ef3a None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:51.265512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 654/1295] 10.222.0.11 () {60 vars in 1141 bytes} [Tue May 3 08:43:51 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:43:53.450576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b515-755a-4bf1-9dc9-5eba1552373e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:53.451158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b515-755a-4bf1-9dc9-5eba1552373e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:53.451158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b515-755a-4bf1-9dc9-5eba1552373e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:53.452524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 642/1296] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:53.458641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:53.459396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:53.459716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:53.488251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:53.490044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:53.566708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 655/1297] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:53.595690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b515-755a-4bf1-9dc9-5eba1552373e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:53.697034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b515-755a-4bf1-9dc9-5eba1552373e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:53.744646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:53.745368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:53.745644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:53.745912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:53.746562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:53.747991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:53.760277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:53.761401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:53.762289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 643/1298] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:43:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:53.767622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:53.877426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bac5e-f126-4c16-97ce-917726b6aeea None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:53.911723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:53.912456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:53.912736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:53.913008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:53.913702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:53.914009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:53.915465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:53.922274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 656/1299] 10.222.0.11 () {56 vars in 1116 bytes} [Tue May 3 08:43:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:53.929938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:54.043819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b34-9ecd-40fa-b1a0-9043a7d6b014 None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:54.079071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:54.079713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:54.080015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:54.080296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:54.081068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] RBAC: Adding query filter params (interface=public, service_id=2e3914bea9be4ffabffb5f7f6e8832c6, region_id=RegionOne) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:54.081374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:54.082733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb397-ea48-491f-b384-540c9b66e3ae None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:54.087814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 644/1300] 10.222.0.11 () {56 vars in 1251 bytes} [Tue May 3 08:43:53 2022] GET /identity/v3/endpoints?service_id=2e3914bea9be4ffabffb5f7f6e8832c6&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:54.093941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:54.189374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af624-378c-4b54-97c6-6c22e3a16493 None admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:54.224571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:54.225232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:54.225511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:54.225776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:54.226450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:54.227801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7f6d3-02b9-40ad-acce-8c63d419afe4 None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:54.234852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 657/1301] 10.222.0.11 () {56 vars in 1087 bytes} [Tue May 3 08:43:54 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:43:56.412333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf744-2aab-4b28-976d-549f3e12b3e1 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:56.413167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf744-2aab-4b28-976d-549f3e12b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:56.413167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf744-2aab-4b28-976d-549f3e12b3e1 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:56.415353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 645/1302] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:43:56.421566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:56.422349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:56.422509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:56.441443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:43:56.442609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:43:56.509890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 658/1303] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:43:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:43:56.536333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bf744-2aab-4b28-976d-549f3e12b3e1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:56.649589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bf744-2aab-4b28-976d-549f3e12b3e1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:56.691311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:56.692145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:56.692423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:56.692693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:56.693331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:56.694708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:43:56.706607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:43:56.707872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application with Lock( May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self._enter() May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application return self.creator() May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application created_value = creator( May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: ERROR keystone.server.flask.application May 03 08:43:56.708916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 646/1304] 10.222.0.11 () {56 vars in 1117 bytes} [Tue May 3 08:43:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:43:56.714625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:56.821819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e68ee-9743-426f-960e-16ec935f9a08 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:56.855413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:56.856104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:56.856383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:56.856650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] PATH_INFO: `/v3/services` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:56.857341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:43:56.857966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:56.859319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32e570-9abf-402a-b219-22cef7e9759e None admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:56.864304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 659/1305] 10.222.0.11 () {56 vars in 1116 bytes} [Tue May 3 08:43:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:43:56.873657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:43:56.978449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45f79-c025-40f8-a509-c0c7d93728ac None admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:43:57.013235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554a078-4af5-4561-a370-88087807521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:43:57.013869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554a078-4af5-4561-a370-88087807521f None admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:43:57.014141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554a078-4af5-4561-a370-88087807521f None admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:43:57.014619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554a078-4af5-4561-a370-88087807521f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:43:57.015342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554a078-4af5-4561-a370-88087807521f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:43:57.016719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554a078-4af5-4561-a370-88087807521f None admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:43:57.039917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 647/1306] 10.222.0.11 () {60 vars in 1144 bytes} [Tue May 3 08:43:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:45:00.480124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fbcf-a562-4ee9-8f32-c59f32307a82 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:00.480623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fbcf-a562-4ee9-8f32-c59f32307a82 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:00.480707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fbcf-a562-4ee9-8f32-c59f32307a82 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:00.482183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 660/1307] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:00.487552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904838-9db2-4e4f-87ba-8be4352af044 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:00.488584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904838-9db2-4e4f-87ba-8be4352af044 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:00.489084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904838-9db2-4e4f-87ba-8be4352af044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:00.568441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ea904838-9db2-4e4f-87ba-8be4352af044 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:00.570102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ea904838-9db2-4e4f-87ba-8be4352af044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:00.704468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 648/1308] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:00.739988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:00.740513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:00.741001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:00.744156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 661/1309] 10.222.0.11 () {54 vars in 964 bytes} [Tue May 3 08:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:00.751272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159384-c444-44a3-933f-d0cb522d30a2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:00.751627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159384-c444-44a3-933f-d0cb522d30a2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:00.752125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159384-c444-44a3-933f-d0cb522d30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:00.844328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-25159384-c444-44a3-933f-d0cb522d30a2 None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:00.845676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-25159384-c444-44a3-933f-d0cb522d30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:00.925070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 649/1310] 10.222.0.11 () {58 vars in 1061 bytes} [Tue May 3 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:45:00.934134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:00.936452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:01.056728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a713-035d-452e-982e-e819b0eecc29 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:01.130538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:01.131192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:01.131471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:01.131741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:01.133408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:01.243147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:01.244721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9db221-0ac6-426f-a348-09d45fcd3826 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:01.264402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 662/1311] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:03.746886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:03.747405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:03.747496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:03.748914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 650/1312] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:03.754356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0acb-e6e1-4de6-8d6e-adccd2ca1852 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:03.754763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0acb-e6e1-4de6-8d6e-adccd2ca1852 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:03.754905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0acb-e6e1-4de6-8d6e-adccd2ca1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:03.838814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b1fd0acb-e6e1-4de6-8d6e-adccd2ca1852 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:03.839954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b1fd0acb-e6e1-4de6-8d6e-adccd2ca1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:03.937413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 663/1313] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:03.975098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:03.976666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:04.082991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd5ec-6fd8-49ed-a7b9-bb6dda9245fb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:04.154757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:04.155407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:04.155659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:04.155993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:04.157625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:04.267118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:04.268585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786c7c-aeff-448d-95fb-af4ffe28174e service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:04.286918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 651/1314] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:06.793516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef163bf-18ba-43ef-992f-f66908038645 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:06.794119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef163bf-18ba-43ef-992f-f66908038645 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:06.794119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef163bf-18ba-43ef-992f-f66908038645 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:06.795381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 664/1315] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:06.800705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a6ba-c03c-45bd-886d-7492adc86775 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:06.801125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a6ba-c03c-45bd-886d-7492adc86775 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:06.801236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a6ba-c03c-45bd-886d-7492adc86775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:06.879740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-28c2a6ba-c03c-45bd-886d-7492adc86775 None None] MFA Rules not processed for user `6de2d4f4e1ca4bf487457c92fe35f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:06.881129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-28c2a6ba-c03c-45bd-886d-7492adc86775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:06.985253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 652/1316] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:07.043049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:07.043414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:07.043935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:07.045760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 665/1317] 10.222.0.11 () {54 vars in 964 bytes} [Tue May 3 08:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:07.052059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c872c0-df56-4c53-af61-25ba558db7dc None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:07.052342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c872c0-df56-4c53-af61-25ba558db7dc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:07.052612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c872c0-df56-4c53-af61-25ba558db7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:07.126611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-27c872c0-df56-4c53-af61-25ba558db7dc None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:07.127799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-27c872c0-df56-4c53-af61-25ba558db7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:07.204375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 653/1318] 10.222.0.11 () {58 vars in 1061 bytes} [Tue May 3 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:07.213731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:07.215270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:07.319262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e8784-6009-4d44-93c0-d076d2cede85 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:07.400315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:07.400960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:07.401217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:07.401524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:07.403167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:07.517224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:07.518668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db454429-6d03-4c8a-b8e2-19c96888cddb service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:07.536880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 666/1319] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:10.648593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:10.649468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:10.649468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:10.651721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 654/1320] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:10.658076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c9b1-d9f6-428e-8fda-581de0d58011 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:10.658501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c9b1-d9f6-428e-8fda-581de0d58011 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:10.658638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c9b1-d9f6-428e-8fda-581de0d58011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:10.734082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0975c9b1-d9f6-428e-8fda-581de0d58011 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:10.735916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0975c9b1-d9f6-428e-8fda-581de0d58011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:10.829808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 667/1321] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:10.872180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:10.874630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:10.997218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc78138-7185-4c0a-b5d3-74f88cffb794 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:11.067462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:11.068127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:11.068402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:11.068675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:11.070290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:11.185872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:11.187311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc83cb-1cc2-4e9a-80f7-89567a9a2666 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:11.206697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 655/1322] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:14.085898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:14.086541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:14.086541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:14.088129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 668/1323] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:14.093770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc66f-3910-41fe-bd8c-36b6cf6eb627 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:14.094167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc66f-3910-41fe-bd8c-36b6cf6eb627 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:14.094322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc66f-3910-41fe-bd8c-36b6cf6eb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:14.158792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e65fc66f-3910-41fe-bd8c-36b6cf6eb627 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:14.160016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e65fc66f-3910-41fe-bd8c-36b6cf6eb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:14.257262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 656/1324] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:14.293416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:14.294947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:14.394317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3af27-d294-47f7-8b83-fd481feff516 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:14.465804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:14.466449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:14.466700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:14.467022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:14.468643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:14.578992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:14.580612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb95f58-3449-4207-9aba-f3588a86d97a service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:14.601130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 669/1325] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:16.888352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:16.888949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:16.888949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:16.890253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 657/1326] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:16.895792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431cd5-f36a-495f-b8e8-a0b919450eb7 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:16.896223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431cd5-f36a-495f-b8e8-a0b919450eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:16.896328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431cd5-f36a-495f-b8e8-a0b919450eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:16.959990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2b431cd5-f36a-495f-b8e8-a0b919450eb7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:16.961189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2b431cd5-f36a-495f-b8e8-a0b919450eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:17.056237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 670/1327] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:17.091731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:17.093360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:17.198925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5a958-5ca8-4138-a95a-fb1dec4003c4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:17.273760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:17.274410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:17.274683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:17.274953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:17.276594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:17.379145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:17.380613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8649e10-3d07-484f-9840-1ea895244eae service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:17.398401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 658/1328] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:19.648601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:19.649145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:19.649145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:19.650516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 671/1329] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:19.655648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b0ba-e532-4593-9ace-0cefd3ef81f3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:19.656121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b0ba-e532-4593-9ace-0cefd3ef81f3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:19.656235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b0ba-e532-4593-9ace-0cefd3ef81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:19.720482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-eca1b0ba-e532-4593-9ace-0cefd3ef81f3 None None] MFA Rules not processed for user `6de2d4f4e1ca4bf487457c92fe35f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:19.721692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eca1b0ba-e532-4593-9ace-0cefd3ef81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:19.818047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 659/1330] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:19.858482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:19.860169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:19.960665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425db11-e7bd-4939-bb56-92c121c9b625 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:20.032561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:20.033201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:20.033481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:20.033758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:20.035405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:20.147630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:20.149088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305dcd-392c-4329-8bed-56c35b0415aa service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:20.167221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 672/1331] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:45:22.651269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:22.651861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:22.651861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:22.653232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 660/1332] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:22.659348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77f67-58cf-466a-8194-7e7c743bf70f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:22.659836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77f67-58cf-466a-8194-7e7c743bf70f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:22.659948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77f67-58cf-466a-8194-7e7c743bf70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:22.735160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b3d77f67-58cf-466a-8194-7e7c743bf70f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:22.736320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b3d77f67-58cf-466a-8194-7e7c743bf70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:22.833476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 673/1333] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:22.869454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:22.870968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:22.977611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659da9b-544b-455d-b3cd-74befd2f2973 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:23.055732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:23.056420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:23.056847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:23.057124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:23.058751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:23.168241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:23.169695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024204d-2f49-435d-96f4-789556187639 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:23.188177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 661/1334] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:25.440100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:25.440954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:25.440954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:25.443153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 674/1335] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:25.449370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e584-7af5-4481-9e79-959556f3bef3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:25.450135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e584-7af5-4481-9e79-959556f3bef3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:25.450267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e584-7af5-4481-9e79-959556f3bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:25.520542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a870e584-7af5-4481-9e79-959556f3bef3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:25.521645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a870e584-7af5-4481-9e79-959556f3bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:25.624460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 662/1336] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:25.671889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:25.673538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:25.779418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac52ef-53f4-4cfd-a1f3-c078323ec295 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:25.849317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:25.849948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:25.850219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:25.850485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:25.852107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:25.961914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:25.963337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81a106-53e6-4fbe-8d3d-fee9f608acfa service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:25.981245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 675/1337] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:28.540498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:28.541326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:28.541326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:28.543390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 663/1338] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:28.549730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877f09-aacd-4621-ba1d-ebd13e80a432 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:28.550168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877f09-aacd-4621-ba1d-ebd13e80a432 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:28.550378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877f09-aacd-4621-ba1d-ebd13e80a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:28.629926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1f877f09-aacd-4621-ba1d-ebd13e80a432 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:28.631215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1f877f09-aacd-4621-ba1d-ebd13e80a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:28.745217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 676/1339] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:28.786310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:28.788686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:28.899704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2a5a3-2d84-429b-af56-49ee8cbc8d52 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:28.978368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:28.979013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:28.979287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:28.979553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:28.981214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:29.086726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:29.088196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87058094-36c0-4e4b-a113-1ed2792f6792 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:29.112288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 664/1340] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:33.327129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:33.327663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:33.327663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:33.329229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 677/1341] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:33.334599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35eaa-4d50-4910-bbbe-86b866f12532 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:33.335042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35eaa-4d50-4910-bbbe-86b866f12532 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:33.335268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35eaa-4d50-4910-bbbe-86b866f12532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:33.405594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-cad35eaa-4d50-4910-bbbe-86b866f12532 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:33.406777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cad35eaa-4d50-4910-bbbe-86b866f12532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:33.510096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 665/1342] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:45:33.547719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:33.550078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:33.643886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a3f2-e655-4b11-a17a-e513de05d799 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:33.647689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:33.648373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:33.648653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:33.648926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:33.658101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:33.659522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd923-8627-4c8b-85cd-be3211540635 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:33.668806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 678/1343] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:36.652794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2c0c-8aa9-4545-bcdf-1efac94c71f2 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:36.653346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2c0c-8aa9-4545-bcdf-1efac94c71f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:36.653346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2c0c-8aa9-4545-bcdf-1efac94c71f2 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:36.654673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 666/1344] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:36.660169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67465-901d-4745-9926-85de896ef839 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:36.660603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67465-901d-4745-9926-85de896ef839 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:36.660749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67465-901d-4745-9926-85de896ef839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:36.688469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-20a67465-901d-4745-9926-85de896ef839 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:36.689669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-20a67465-901d-4745-9926-85de896ef839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:36.771056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 679/1345] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:36.807720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f2c0c-8aa9-4545-bcdf-1efac94c71f2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:36.818825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f2c0c-8aa9-4545-bcdf-1efac94c71f2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:36.822635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:36.823260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:36.823534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:36.823868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:36.836644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:36.838050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64496c0-21dc-4ef3-ae8c-5be8e79100f2 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:36.848391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 667/1346] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:41.235608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c89a5-ab1e-4a07-81ed-8947711e02b8 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:41.236173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c89a5-ab1e-4a07-81ed-8947711e02b8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:41.236268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c89a5-ab1e-4a07-81ed-8947711e02b8 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:41.237649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 680/1347] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:41.242917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32103d-f653-499e-a15c-0283c3497845 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:41.243475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32103d-f653-499e-a15c-0283c3497845 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:41.243475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32103d-f653-499e-a15c-0283c3497845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:41.262382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1e32103d-f653-499e-a15c-0283c3497845 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:41.263561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1e32103d-f653-499e-a15c-0283c3497845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:41.272137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 668/1348] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:41.309321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c89a5-ab1e-4a07-81ed-8947711e02b8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:41.321105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c89a5-ab1e-4a07-81ed-8947711e02b8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:41.324977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:41.325606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:41.325884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:41.326158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:41.335142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:41.336606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83565b-a6ae-4904-babe-f3915af9f95d service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:41.346671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 681/1349] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:46.517496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9609-538f-4244-a89f-8e6c07f06449 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:46.518450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9609-538f-4244-a89f-8e6c07f06449 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:46.518871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9609-538f-4244-a89f-8e6c07f06449 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:46.520695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 669/1350] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:46.526469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4fd4-78f5-48e4-bf1e-5c51824975a4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:46.527263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4fd4-78f5-48e4-bf1e-5c51824975a4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:46.527702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4fd4-78f5-48e4-bf1e-5c51824975a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:46.622189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d12a4fd4-78f5-48e4-bf1e-5c51824975a4 None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:46.623651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d12a4fd4-78f5-48e4-bf1e-5c51824975a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:46.730510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 682/1351] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:50.919381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfef43-3491-4a6d-9f37-a23ea7af0e45 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:50.920871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfef43-3491-4a6d-9f37-a23ea7af0e45 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:50.923171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfef43-3491-4a6d-9f37-a23ea7af0e45 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:50.926870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 670/1352] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:45:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:50.933073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc252a-4488-45cc-9b97-226003f19c40 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:50.933552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc252a-4488-45cc-9b97-226003f19c40 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:50.933660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc252a-4488-45cc-9b97-226003f19c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:50.952446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d2cc252a-4488-45cc-9b97-226003f19c40 None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:50.953635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d2cc252a-4488-45cc-9b97-226003f19c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:50.992390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 683/1353] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:45:52.505764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf285e-4cd9-4c23-84c1-aec2d8f11410 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:52.506277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf285e-4cd9-4c23-84c1-aec2d8f11410 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:52.506277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf285e-4cd9-4c23-84c1-aec2d8f11410 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:52.507610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 671/1354] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:52.512598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42fa6-4f50-47dd-ab14-7fdc47e71acd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:52.513087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42fa6-4f50-47dd-ab14-7fdc47e71acd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:52.513277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42fa6-4f50-47dd-ab14-7fdc47e71acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:52.532418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9da42fa6-4f50-47dd-ab14-7fdc47e71acd None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:52.533673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9da42fa6-4f50-47dd-ab14-7fdc47e71acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:52.543541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 684/1355] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:45:56.270976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f714b8-ec95-42a0-9237-0ddd70be92ff None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:56.271495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f714b8-ec95-42a0-9237-0ddd70be92ff None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:56.271495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f714b8-ec95-42a0-9237-0ddd70be92ff None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:56.272993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 672/1356] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:56.277995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6657-4cfd-4643-bdbe-59ddbd314896 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:56.278413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6657-4cfd-4643-bdbe-59ddbd314896 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:56.278516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6657-4cfd-4643-bdbe-59ddbd314896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:56.297504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c79c6657-4cfd-4643-bdbe-59ddbd314896 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:56.298854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c79c6657-4cfd-4643-bdbe-59ddbd314896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:56.307885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 685/1357] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:56.355299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c1db-886e-4b76-acd5-3db59fe9e7a7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:56.355944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c1db-886e-4b76-acd5-3db59fe9e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:56.356241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c1db-886e-4b76-acd5-3db59fe9e7a7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:56.357621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 673/1358] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:45:56.362983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adb3b-3b4c-4f24-aa28-db4845baf8eb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:56.363373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adb3b-3b4c-4f24-aa28-db4845baf8eb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:56.363746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adb3b-3b4c-4f24-aa28-db4845baf8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:56.412962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6b3adb3b-3b4c-4f24-aa28-db4845baf8eb None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:56.414140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6b3adb3b-3b4c-4f24-aa28-db4845baf8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:56.493198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 686/1359] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:56.501367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c1db-886e-4b76-acd5-3db59fe9e7a7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:56.515938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c1db-886e-4b76-acd5-3db59fe9e7a7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:56.521736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:56.522307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:56.522583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:56.522852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:56.530798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:56.532601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579e13-5e27-4c6a-9e76-43306fd9b45a service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:56.542111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 674/1360] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:45:58.980869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457ccf-7aa9-42bd-926f-7a82a4e9749d None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:58.981543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457ccf-7aa9-42bd-926f-7a82a4e9749d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:58.981543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457ccf-7aa9-42bd-926f-7a82a4e9749d None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:58.982742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 687/1361] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:45:58.988604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda19f4a-67db-4984-8360-805d33d6fa5a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:58.989060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda19f4a-67db-4984-8360-805d33d6fa5a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:58.989154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda19f4a-67db-4984-8360-805d33d6fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:59.007565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-dda19f4a-67db-4984-8360-805d33d6fa5a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:45:59.008778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dda19f4a-67db-4984-8360-805d33d6fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:45:59.017150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 675/1362] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:45:59.060690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c457ccf-7aa9-42bd-926f-7a82a4e9749d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:45:59.077196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c457ccf-7aa9-42bd-926f-7a82a4e9749d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:45:59.083695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:45:59.084377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:45:59.084660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:45:59.084936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:45:59.093632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:45:59.095223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f36e-3da0-47f1-b6e0-f6db435f5cdf service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:45:59.104891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 688/1363] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:01.630184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700e16-bc97-4eb0-ab76-7849c515c453 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:01.630692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700e16-bc97-4eb0-ab76-7849c515c453 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:01.630796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700e16-bc97-4eb0-ab76-7849c515c453 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:01.632164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 676/1364] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:01.641668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b0fe-798f-40f6-aebc-cceafac317b5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:01.641668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b0fe-798f-40f6-aebc-cceafac317b5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:01.641668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b0fe-798f-40f6-aebc-cceafac317b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:01.656178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8f67b0fe-798f-40f6-aebc-cceafac317b5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:01.657426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8f67b0fe-798f-40f6-aebc-cceafac317b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:01.665570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 689/1365] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:01.712555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d735aa-4df9-443d-89cf-7e454281c57e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:01.712841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d735aa-4df9-443d-89cf-7e454281c57e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:01.713118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d735aa-4df9-443d-89cf-7e454281c57e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:01.714523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 677/1366] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:01.720746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ada0-0ac6-4f20-972b-951c1a2756c2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:01.721236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ada0-0ac6-4f20-972b-951c1a2756c2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:01.721509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ada0-0ac6-4f20-972b-951c1a2756c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:01.740875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4b40ada0-0ac6-4f20-972b-951c1a2756c2 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:01.741989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4b40ada0-0ac6-4f20-972b-951c1a2756c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:01.751075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 690/1367] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:01.758973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d735aa-4df9-443d-89cf-7e454281c57e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:01.773146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d735aa-4df9-443d-89cf-7e454281c57e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:01.778504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:01.779138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:01.779415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:01.779713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:01.787584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:01.789204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2689-e75d-4779-a58c-4f6efe58f665 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:01.798314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 678/1368] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:04.090640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b895-8b3e-433a-a3fa-50f48b00099a None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.091186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b895-8b3e-433a-a3fa-50f48b00099a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.091186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b895-8b3e-433a-a3fa-50f48b00099a None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.092477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 691/1369] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:04.097988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1484-e46d-4606-8828-1c7dfb9b8aab None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.098423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1484-e46d-4606-8828-1c7dfb9b8aab None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.098519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1484-e46d-4606-8828-1c7dfb9b8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.116532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-274b1484-e46d-4606-8828-1c7dfb9b8aab None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:04.117715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-274b1484-e46d-4606-8828-1c7dfb9b8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:04.125786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 679/1370] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:46:04.168984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982b895-8b3e-433a-a3fa-50f48b00099a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:04.183835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982b895-8b3e-433a-a3fa-50f48b00099a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:04.189581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:04.190415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.190698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.190971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.199599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:04.201387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbddd4a-d13f-46f5-913c-3492aa3c2d41 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:04.215100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 692/1371] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:04.454360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba7aa-3ea3-4340-a4f1-367d851d39cb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.454634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba7aa-3ea3-4340-a4f1-367d851d39cb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.454863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba7aa-3ea3-4340-a4f1-367d851d39cb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.456537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 680/1372] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:04.462600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6fed2-c7f8-4ac6-bba8-fe33bd5db856 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.462906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6fed2-c7f8-4ac6-bba8-fe33bd5db856 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.463174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6fed2-c7f8-4ac6-bba8-fe33bd5db856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.483677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-fed6fed2-c7f8-4ac6-bba8-fe33bd5db856 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:04.484933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fed6fed2-c7f8-4ac6-bba8-fe33bd5db856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:04.493652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 693/1373] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:04.799987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c27-7ca4-44f7-9a11-f448dbc8484a None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.799987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c27-7ca4-44f7-9a11-f448dbc8484a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.799987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c27-7ca4-44f7-9a11-f448dbc8484a None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.799987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 681/1374] 10.222.0.11 () {54 vars in 963 bytes} [Tue May 3 08:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:04.804141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176776-369a-46c8-a0fa-93c2216cddf2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.804431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176776-369a-46c8-a0fa-93c2216cddf2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.804709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176776-369a-46c8-a0fa-93c2216cddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.850141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-75176776-369a-46c8-a0fa-93c2216cddf2 None None] MFA Rules not processed for user `1d44d26a512a4a92806e60f3cb10dd33`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:04.851327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-75176776-369a-46c8-a0fa-93c2216cddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:04.912442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 694/1375] 10.222.0.11 () {58 vars in 1060 bytes} [Tue May 3 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:04.920220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3c27-7ca4-44f7-9a11-f448dbc8484a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:04.932065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3c27-7ca4-44f7-9a11-f448dbc8484a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:04.935725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:04.936638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:04.937148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:04.937491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:04.946729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:04.948289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb781a7c-aa06-4db1-aab5-98aa51a6fd2b service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:04.958154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 682/1376] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:06.488496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee88fe-6d75-4d18-a055-5c5a0290feee None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:06.489053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee88fe-6d75-4d18-a055-5c5a0290feee None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:06.489053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee88fe-6d75-4d18-a055-5c5a0290feee None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:06.490362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 695/1377] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:06.496667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5c0f4-fa19-4771-8ac0-dbe8ca80b68f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:06.497313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5c0f4-fa19-4771-8ac0-dbe8ca80b68f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:06.497313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5c0f4-fa19-4771-8ac0-dbe8ca80b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:06.516493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5ee5c0f4-fa19-4771-8ac0-dbe8ca80b68f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:06.517712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5ee5c0f4-fa19-4771-8ac0-dbe8ca80b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:06.526225 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 683/1378] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:06.570675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee88fe-6d75-4d18-a055-5c5a0290feee None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:06.585274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee88fe-6d75-4d18-a055-5c5a0290feee None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:06.590919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:06.591584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:06.591889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:06.592166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:06.601796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:06.603729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5b3e2-0dbd-4e72-aaca-5e15814ba5d1 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:06.614531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 696/1379] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:46:08.869883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7df51-753e-46ff-9bd9-67223036b3fc None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:08.870557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7df51-753e-46ff-9bd9-67223036b3fc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:08.870557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7df51-753e-46ff-9bd9-67223036b3fc None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:08.871860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 684/1380] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:08.877233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2d1-da04-47b2-9723-5488e1afddd3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:08.877724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2d1-da04-47b2-9723-5488e1afddd3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:08.877724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2d1-da04-47b2-9723-5488e1afddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:08.895714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c97ae2d1-da04-47b2-9723-5488e1afddd3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:08.897201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c97ae2d1-da04-47b2-9723-5488e1afddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:08.909008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 697/1381] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:08.948683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7df51-753e-46ff-9bd9-67223036b3fc None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:08.963687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7df51-753e-46ff-9bd9-67223036b3fc None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:08.969313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:08.969951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:08.970231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:08.970504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:08.979459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:08.981069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e215-7ae2-4e33-8a1b-64be6ac47558 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:08.990475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 685/1382] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:11.244791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9fc40-6962-4630-9049-da57719379a5 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:11.245380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9fc40-6962-4630-9049-da57719379a5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:11.245380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9fc40-6962-4630-9049-da57719379a5 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:11.246669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 698/1383] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:11.251975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017835e-0924-49bf-b5e2-dd105544b960 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:11.252449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017835e-0924-49bf-b5e2-dd105544b960 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:11.252555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017835e-0924-49bf-b5e2-dd105544b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:11.271212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1017835e-0924-49bf-b5e2-dd105544b960 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:11.272457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1017835e-0924-49bf-b5e2-dd105544b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:11.281571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 686/1384] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:11.327069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9fc40-6962-4630-9049-da57719379a5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:11.342872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9fc40-6962-4630-9049-da57719379a5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:11.349570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:11.350230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:11.350479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:11.350982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:11.360693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:11.362479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ab84-63a6-4202-ab70-dbfb52f5b532 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:11.372568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 699/1385] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:13.607187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394193a-9194-4b8b-add3-6959a59589fa None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:13.607919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394193a-9194-4b8b-add3-6959a59589fa None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:13.607919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394193a-9194-4b8b-add3-6959a59589fa None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:13.609215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 687/1386] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:13.614463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d17a5-0071-4dfb-9df5-13a1589f766d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:13.614957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d17a5-0071-4dfb-9df5-13a1589f766d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:13.615145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d17a5-0071-4dfb-9df5-13a1589f766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:13.636758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b27d17a5-0071-4dfb-9df5-13a1589f766d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:13.638594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b27d17a5-0071-4dfb-9df5-13a1589f766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:13.650119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 700/1387] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:13.703485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394193a-9194-4b8b-add3-6959a59589fa None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:13.721699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394193a-9194-4b8b-add3-6959a59589fa None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:13.728859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:13.729524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:13.729811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:13.730064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:13.738635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:13.740262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a317d0-b9b5-4c27-adb9-28ef16344895 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:13.751057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 688/1388] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:46:16.111888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241920e-d6cf-462f-8280-d78ac440a6fd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:16.112493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241920e-d6cf-462f-8280-d78ac440a6fd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:16.112493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241920e-d6cf-462f-8280-d78ac440a6fd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:16.114073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 701/1389] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:16.119410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ef35-2c5c-480b-84ba-f327b4030933 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:16.119841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ef35-2c5c-480b-84ba-f327b4030933 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:16.120046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ef35-2c5c-480b-84ba-f327b4030933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:16.137992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7331ef35-2c5c-480b-84ba-f327b4030933 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:16.139215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7331ef35-2c5c-480b-84ba-f327b4030933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:16.149107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 689/1390] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:46:16.193747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241920e-d6cf-462f-8280-d78ac440a6fd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:16.208796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241920e-d6cf-462f-8280-d78ac440a6fd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:16.215188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:16.216073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:16.216446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:16.216830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:16.229585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:16.231713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0273635-f594-4584-9c86-e3f4c8af935d service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:16.245211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 702/1391] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:18.877206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29c49-072e-457d-ba09-c9a434e97eb3 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:18.877906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29c49-072e-457d-ba09-c9a434e97eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:18.877906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29c49-072e-457d-ba09-c9a434e97eb3 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:18.879097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 690/1392] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:18.884350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e3c7-d489-4d15-8a53-d7775d4bbc45 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:18.884843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e3c7-d489-4d15-8a53-d7775d4bbc45 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:18.884961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e3c7-d489-4d15-8a53-d7775d4bbc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:18.902852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c2c5e3c7-d489-4d15-8a53-d7775d4bbc45 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:18.904055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c2c5e3c7-d489-4d15-8a53-d7775d4bbc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:18.912109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 703/1393] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:18.958715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f29c49-072e-457d-ba09-c9a434e97eb3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:18.974788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f29c49-072e-457d-ba09-c9a434e97eb3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:18.980978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:18.981619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:18.981899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:18.982171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:18.990747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:18.992371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3737114-26c9-49dc-b636-b316101ab41b service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:19.001693 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 691/1394] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:20.882664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db394c-1c0c-4448-8bc7-db17cef23bd2 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:20.883271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db394c-1c0c-4448-8bc7-db17cef23bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:20.883271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db394c-1c0c-4448-8bc7-db17cef23bd2 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:20.884645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 704/1395] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:20.890136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfe56-008a-44cf-be47-4fd9090fd10b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:20.890604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfe56-008a-44cf-be47-4fd9090fd10b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:20.890792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfe56-008a-44cf-be47-4fd9090fd10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:20.909671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-25ecfe56-008a-44cf-be47-4fd9090fd10b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:20.910850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-25ecfe56-008a-44cf-be47-4fd9090fd10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:20.920231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 692/1396] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:20.976463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb851-7535-427f-a4e0-69f3649fe19c None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:20.976758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb851-7535-427f-a4e0-69f3649fe19c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:20.977036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb851-7535-427f-a4e0-69f3649fe19c None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:20.978404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 705/1397] 10.222.0.11 () {54 vars in 962 bytes} [Tue May 3 08:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:20.983802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47a93-3ecb-47da-9b8f-d10bc6a9c239 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:20.984113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47a93-3ecb-47da-9b8f-d10bc6a9c239 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:20.984403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47a93-3ecb-47da-9b8f-d10bc6a9c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.031683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b7d47a93-3ecb-47da-9b8f-d10bc6a9c239 None None] MFA Rules not processed for user `45dbe9ca0c3f4d37906a4a42c6e45545`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:21.032895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b7d47a93-3ecb-47da-9b8f-d10bc6a9c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:21.095970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 693/1398] 10.222.0.11 () {58 vars in 1059 bytes} [Tue May 3 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:21.104102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb851-7535-427f-a4e0-69f3649fe19c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:21.115288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb851-7535-427f-a4e0-69f3649fe19c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:21.119975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:21.120622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.120902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.121173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.130786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:21.132262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5b4b1-c21f-49db-aae3-56dfa5c60f14 service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:21.141881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 706/1399] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:46:21.240866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041910-4da5-4f07-83b9-47a8a926229b None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.241155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041910-4da5-4f07-83b9-47a8a926229b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.241433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041910-4da5-4f07-83b9-47a8a926229b None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.242855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 694/1400] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:21.248147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b07fb2-cda6-498a-b040-dd0a9e4a181c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.248440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b07fb2-cda6-498a-b040-dd0a9e4a181c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.248718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b07fb2-cda6-498a-b040-dd0a9e4a181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.267016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e6b07fb2-cda6-498a-b040-dd0a9e4a181c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:21.268255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e6b07fb2-cda6-498a-b040-dd0a9e4a181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:21.277644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 707/1401] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:21.329546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041910-4da5-4f07-83b9-47a8a926229b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:21.349919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041910-4da5-4f07-83b9-47a8a926229b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:21.356624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:21.357307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.357582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.357851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.366821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:21.368524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0844a06-1372-44ef-b1df-398d3fc18ec0 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:21.378177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 695/1402] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:21.587976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e120b-a461-4a46-9556-65d0e080a780 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.588478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e120b-a461-4a46-9556-65d0e080a780 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.588765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e120b-a461-4a46-9556-65d0e080a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.641796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-cb8e120b-a461-4a46-9556-65d0e080a780 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:21.642985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cb8e120b-a461-4a46-9556-65d0e080a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:21.708362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 708/1403] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:21.758616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd0b1-c6ca-41a3-ac99-d9e13f5c9856 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.758932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd0b1-c6ca-41a3-ac99-d9e13f5c9856 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.759219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd0b1-c6ca-41a3-ac99-d9e13f5c9856 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.760646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 696/1404] 10.222.0.11 () {54 vars in 942 bytes} [Tue May 3 08:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:21.767333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b262b6-033a-404d-ba71-708f6a03d208 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.767685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b262b6-033a-404d-ba71-708f6a03d208 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.768044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b262b6-033a-404d-ba71-708f6a03d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.815346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c0b262b6-033a-404d-ba71-708f6a03d208 None None] MFA Rules not processed for user `fe4065401c1645baa29331521821162e`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:21.816684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c0b262b6-033a-404d-ba71-708f6a03d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:21.886852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 709/1405] 10.222.0.11 () {58 vars in 1039 bytes} [Tue May 3 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:21.896510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfd0b1-c6ca-41a3-ac99-d9e13f5c9856 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:21.910299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfd0b1-c6ca-41a3-ac99-d9e13f5c9856 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:21.915305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:21.915988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:21.916268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:21.916539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:21.924526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:21.926087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddae51-32de-4231-87bd-97cb0ee5b85d service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:21.934462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 697/1406] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 08:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:46:23.659099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92862e-a31e-446f-bdb3-b0336f7e3d54 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:23.659656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92862e-a31e-446f-bdb3-b0336f7e3d54 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:23.659656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92862e-a31e-446f-bdb3-b0336f7e3d54 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:23.661075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 710/1407] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:23.666486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c12e-a911-4a30-aac3-4cf3f140adcd None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:23.666925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c12e-a911-4a30-aac3-4cf3f140adcd None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:23.667023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c12e-a911-4a30-aac3-4cf3f140adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:23.689133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e129c12e-a911-4a30-aac3-4cf3f140adcd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:23.690427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e129c12e-a911-4a30-aac3-4cf3f140adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:23.699032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 698/1408] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:23.747261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92862e-a31e-446f-bdb3-b0336f7e3d54 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:23.761981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92862e-a31e-446f-bdb3-b0336f7e3d54 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:23.768502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:23.769150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:23.769431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:23.769722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:23.778702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:23.780325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a29d-58cb-44f4-8bee-8d677c36b83d service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:23.790287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 711/1409] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:45.850488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06cb9-945e-4a62-8b57-3b15e2e14cee None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:45.851156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06cb9-945e-4a62-8b57-3b15e2e14cee None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:45.851156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06cb9-945e-4a62-8b57-3b15e2e14cee None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:45.852442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 699/1410] 10.222.0.11 () {54 vars in 918 bytes} [Tue May 3 08:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:45.861246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af89-3071-4ffa-b12f-45b04b9943fa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:45.861718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af89-3071-4ffa-b12f-45b04b9943fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:45.861845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af89-3071-4ffa-b12f-45b04b9943fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:45.885687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6713af89-3071-4ffa-b12f-45b04b9943fa None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:45.886901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6713af89-3071-4ffa-b12f-45b04b9943fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:45.897487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 712/1411] 10.222.0.11 () {58 vars in 1015 bytes} [Tue May 3 08:46:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:46:45.915729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833144de-6039-4abf-9974-5216f85e7a73 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:45.916052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833144de-6039-4abf-9974-5216f85e7a73 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:45.916344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833144de-6039-4abf-9974-5216f85e7a73 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:45.917706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 700/1412] 10.222.0.11 () {54 vars in 918 bytes} [Tue May 3 08:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:45.922415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e2-b261-440e-9b8b-d3a7ec64780f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:45.922802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e2-b261-440e-9b8b-d3a7ec64780f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:45.923080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e2-b261-440e-9b8b-d3a7ec64780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:45.941925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-29e418e2-b261-440e-9b8b-d3a7ec64780f None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:45.943099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-29e418e2-b261-440e-9b8b-d3a7ec64780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:45.953962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 713/1413] 10.222.0.11 () {58 vars in 1015 bytes} [Tue May 3 08:46:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:48.640090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce7da-2f4b-4643-a90e-92531c5b0b61 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:48.640641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce7da-2f4b-4643-a90e-92531c5b0b61 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:48.640641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce7da-2f4b-4643-a90e-92531c5b0b61 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:48.641912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:48.648173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6791f-f9f9-48f5-9592-d3d21efb6f2e None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:48.648833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6791f-f9f9-48f5-9592-d3d21efb6f2e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:48.648981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6791f-f9f9-48f5-9592-d3d21efb6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:48.671218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d7e6791f-f9f9-48f5-9592-d3d21efb6f2e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:48.672430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d7e6791f-f9f9-48f5-9592-d3d21efb6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:48.681445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:48.722804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce7da-2f4b-4643-a90e-92531c5b0b61 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:48.745175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce7da-2f4b-4643-a90e-92531c5b0b61 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:48.753635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:48.754272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:48.754549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:48.754819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:48.763097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:48.764712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582974c-c8c7-45d9-b8c9-bd4fd3180f80 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:48.774249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 702/1416] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:50.058825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05e3f-31c6-49f5-99c4-43116ba5a0d4 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:50.059714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05e3f-31c6-49f5-99c4-43116ba5a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:50.059714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05e3f-31c6-49f5-99c4-43116ba5a0d4 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:50.061923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:50.066933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d73d-7ffa-42bd-bf22-2b2998ec26d1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:50.067426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d73d-7ffa-42bd-bf22-2b2998ec26d1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:50.067426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d73d-7ffa-42bd-bf22-2b2998ec26d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:50.086944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f774d73d-7ffa-42bd-bf22-2b2998ec26d1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:50.088136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f774d73d-7ffa-42bd-bf22-2b2998ec26d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:50.098362 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:50.272535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde05e3f-31c6-49f5-99c4-43116ba5a0d4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:50.291373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde05e3f-31c6-49f5-99c4-43116ba5a0d4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:50.297106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:50.297732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:50.298156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:50.298267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:50.306747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:50.308373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23422f69-c99c-4ffd-9add-c39df1bc9295 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:50.317887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 716/1419] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:51.565054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0064d3-ac32-4ca6-b430-1e6004fe0783 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:51.565916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0064d3-ac32-4ca6-b430-1e6004fe0783 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:51.565916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0064d3-ac32-4ca6-b430-1e6004fe0783 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:51.568014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:51.575970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-be62-41c5-8767-f5dbf3704a5c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:51.576722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-be62-41c5-8767-f5dbf3704a5c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:51.576876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-be62-41c5-8767-f5dbf3704a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:51.597722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-acaaaea5-be62-41c5-8767-f5dbf3704a5c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:51.598904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-acaaaea5-be62-41c5-8767-f5dbf3704a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:51.607735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:51.755195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0064d3-ac32-4ca6-b430-1e6004fe0783 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:51.778782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0064d3-ac32-4ca6-b430-1e6004fe0783 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:51.786197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:51.786834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:51.787114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:51.787383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:51.796032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:51.797621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593fb4-1f1e-4dc1-ac84-774c3b7a5a16 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:51.807416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 705/1422] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:53.038500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6fec-968c-4fee-9055-7ccedba463ff None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:53.039100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6fec-968c-4fee-9055-7ccedba463ff None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:53.039100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6fec-968c-4fee-9055-7ccedba463ff None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:53.040505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:53.046481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bbb7d-2c9b-41eb-83a4-25141dfa5f8d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:53.047207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bbb7d-2c9b-41eb-83a4-25141dfa5f8d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:53.047371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bbb7d-2c9b-41eb-83a4-25141dfa5f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:53.072744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f94bbb7d-2c9b-41eb-83a4-25141dfa5f8d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:53.073929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f94bbb7d-2c9b-41eb-83a4-25141dfa5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:53.082317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:53.229193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6fec-968c-4fee-9055-7ccedba463ff None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:53.251553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6fec-968c-4fee-9055-7ccedba463ff None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:53.258614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:53.259273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:53.259548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:53.259841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:53.269148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:53.270731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4037b3-a1d6-4bb8-8e90-7d256869193f service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:53.280755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 719/1425] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:54.530372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ae4-0a4c-476f-b720-48a1eb614d33 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:54.531208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ae4-0a4c-476f-b720-48a1eb614d33 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:54.531208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ae4-0a4c-476f-b720-48a1eb614d33 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:54.532869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:54.538263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ecbc1-df8a-4692-9bc8-5241267da672 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:54.538681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ecbc1-df8a-4692-9bc8-5241267da672 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:54.538847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ecbc1-df8a-4692-9bc8-5241267da672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:54.564337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-928ecbc1-df8a-4692-9bc8-5241267da672 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:54.565523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-928ecbc1-df8a-4692-9bc8-5241267da672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:54.574289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:54.722600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220ae4-0a4c-476f-b720-48a1eb614d33 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:54.739079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220ae4-0a4c-476f-b720-48a1eb614d33 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:54.744755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:54.745394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:54.745672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:54.745950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:54.755782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:54.758107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524aa5-28c6-4fe7-8b01-e3be00bfead3 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:54.773323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 708/1428] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:55.945653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2371dc-a888-4a45-818f-e1c6e8ce6e76 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:55.946332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2371dc-a888-4a45-818f-e1c6e8ce6e76 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:55.946332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2371dc-a888-4a45-818f-e1c6e8ce6e76 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:55.947608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:55.953494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f907-f0c9-4570-9953-154d0689a33f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:55.953939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f907-f0c9-4570-9953-154d0689a33f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:55.954142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f907-f0c9-4570-9953-154d0689a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:55.973292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d358f907-f0c9-4570-9953-154d0689a33f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:55.974497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d358f907-f0c9-4570-9953-154d0689a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:55.984195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:56.135443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2371dc-a888-4a45-818f-e1c6e8ce6e76 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:56.159581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2371dc-a888-4a45-818f-e1c6e8ce6e76 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:56.166115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:56.166731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:56.167006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:56.167277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:56.175874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:56.177454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fa9a-1a61-42ad-872c-2005852f105b service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:56.187155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 722/1431] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:57.366619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c038a-36e5-4b7c-b4b7-9898b88e3694 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:57.367236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c038a-36e5-4b7c-b4b7-9898b88e3694 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:57.367236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c038a-36e5-4b7c-b4b7-9898b88e3694 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:57.368646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:57.373595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d4ec-bfd0-4220-82f0-c4ce5d8543f6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:57.374040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d4ec-bfd0-4220-82f0-c4ce5d8543f6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:57.374168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d4ec-bfd0-4220-82f0-c4ce5d8543f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:57.394424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-26f4d4ec-bfd0-4220-82f0-c4ce5d8543f6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:57.395600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-26f4d4ec-bfd0-4220-82f0-c4ce5d8543f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:57.404612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:46:57.550163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c038a-36e5-4b7c-b4b7-9898b88e3694 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:57.570412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c038a-36e5-4b7c-b4b7-9898b88e3694 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:57.578399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:57.579271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:57.579694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:57.580151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:57.594468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:57.596414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd04ad-6db8-4f45-bc99-ed54685d22d9 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:57.606208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 711/1434] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:46:58.787532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1112d-b365-47b5-a85d-90ba5dfb11b7 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:58.788238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1112d-b365-47b5-a85d-90ba5dfb11b7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:58.788238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1112d-b365-47b5-a85d-90ba5dfb11b7 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:58.790212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:46:58.798413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06cf4-f924-4b7d-9d27-c6140369413a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:58.798840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06cf4-f924-4b7d-9d27-c6140369413a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:58.798982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06cf4-f924-4b7d-9d27-c6140369413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:58.817939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-05c06cf4-f924-4b7d-9d27-c6140369413a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:46:58.819126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-05c06cf4-f924-4b7d-9d27-c6140369413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:46:58.827817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:46:58.973728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1112d-b365-47b5-a85d-90ba5dfb11b7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:46:58.994677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1112d-b365-47b5-a85d-90ba5dfb11b7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:46:59.000499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:46:59.001218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:46:59.001506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:46:59.001785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:46:59.010773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:46:59.012410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc0205-ef68-4e95-8b3a-2c4d4ce2cc54 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:46:59.022707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 725/1437] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:00.199795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d790-4f2b-4554-9ec7-b00527ab0e2d None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:00.200610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d790-4f2b-4554-9ec7-b00527ab0e2d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:00.200610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d790-4f2b-4554-9ec7-b00527ab0e2d None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:00.202707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:00.207457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5136a-e405-45d1-b831-29cc217c3e7a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:00.207924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5136a-e405-45d1-b831-29cc217c3e7a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:00.208013 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5136a-e405-45d1-b831-29cc217c3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:00.226908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bab5136a-e405-45d1-b831-29cc217c3e7a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:00.228110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bab5136a-e405-45d1-b831-29cc217c3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:00.237099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:00.385592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d790-4f2b-4554-9ec7-b00527ab0e2d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:00.402670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d790-4f2b-4554-9ec7-b00527ab0e2d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:00.409795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:00.410431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:00.410710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:00.410981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:00.419448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:00.421706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd329-c5a1-4111-b4ac-9efab3ee5fc6 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:00.432688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 714/1440] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:02.543849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:02.544716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:02.544716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:02.546804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:02.552521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a765f2-3487-4582-9819-f89a8437d36f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:02.552964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a765f2-3487-4582-9819-f89a8437d36f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:02.553061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a765f2-3487-4582-9819-f89a8437d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:02.572780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d8a765f2-3487-4582-9819-f89a8437d36f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:02.573935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d8a765f2-3487-4582-9819-f89a8437d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:02.583782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:02.626680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:02.629759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:02.649231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ccd8e-fe39-4707-be66-1761c442ebe3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:02.653398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:02.654037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:02.654318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:02.654592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:02.663792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:02.665235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cacfa1-6f0e-4980-a461-45e16f153d60 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:02.674561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 728/1443] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:05.046170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabf3b-e408-4e72-b342-24d25fb703f2 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:05.047073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabf3b-e408-4e72-b342-24d25fb703f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:05.047073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabf3b-e408-4e72-b342-24d25fb703f2 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:05.049223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:05.055661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d8f7-31eb-4648-baa5-5cc270b4b319 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:05.056434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d8f7-31eb-4648-baa5-5cc270b4b319 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:05.056626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d8f7-31eb-4648-baa5-5cc270b4b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:05.077914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-72a5d8f7-31eb-4648-baa5-5cc270b4b319 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:05.079085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-72a5d8f7-31eb-4648-baa5-5cc270b4b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:05.093065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:05.136532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cabf3b-e408-4e72-b342-24d25fb703f2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:05.149188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cabf3b-e408-4e72-b342-24d25fb703f2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:05.153631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:05.154278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:05.154569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:05.154833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:05.164609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:05.166041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e94151-6b39-43a1-acc9-04620da6d818 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:05.175652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 717/1446] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:07.771635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882bc3b-8d02-49ff-82dd-04bf66a17a86 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:07.772570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882bc3b-8d02-49ff-82dd-04bf66a17a86 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:07.772570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882bc3b-8d02-49ff-82dd-04bf66a17a86 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:07.774790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:07.783338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f3f-fba0-488c-9767-baa0295915da None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:07.783801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f3f-fba0-488c-9767-baa0295915da None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:07.783921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f3f-fba0-488c-9767-baa0295915da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:07.808094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-279f9f3f-fba0-488c-9767-baa0295915da None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:07.809291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-279f9f3f-fba0-488c-9767-baa0295915da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:07.818452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:07.858673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882bc3b-8d02-49ff-82dd-04bf66a17a86 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:07.871391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882bc3b-8d02-49ff-82dd-04bf66a17a86 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:07.876260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:07.876894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:07.877173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:07.877444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:07.886655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:07.888153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291e9fb-59b1-49f1-8d3a-b3d14b11c641 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:07.897938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 731/1449] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:10.219307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2345-1cbb-42bb-b050-6bcd59cd7049 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:10.219822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2345-1cbb-42bb-b050-6bcd59cd7049 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:10.219822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2345-1cbb-42bb-b050-6bcd59cd7049 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:10.221302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:10.227332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cefad-c1d1-4a6e-8016-f248907b6944 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:10.227831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cefad-c1d1-4a6e-8016-f248907b6944 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:10.227944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cefad-c1d1-4a6e-8016-f248907b6944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:10.247712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2d8cefad-c1d1-4a6e-8016-f248907b6944 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:10.248907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2d8cefad-c1d1-4a6e-8016-f248907b6944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:10.257540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:10.297531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a2345-1cbb-42bb-b050-6bcd59cd7049 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:10.309074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a2345-1cbb-42bb-b050-6bcd59cd7049 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:10.313285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:10.314012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:10.314287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:10.314553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:10.323577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:10.325018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87237d72-db07-4421-8d9f-b750fd84d045 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:10.334207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 720/1452] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:47:12.611733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab875-3acb-4215-8142-b2021c7ae37a None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:12.612604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab875-3acb-4215-8142-b2021c7ae37a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:12.612604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab875-3acb-4215-8142-b2021c7ae37a None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:12.614740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:12.623696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc85c4-9488-441e-80c7-4c06e3c8bcb9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:12.624175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc85c4-9488-441e-80c7-4c06e3c8bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:12.624278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc85c4-9488-441e-80c7-4c06e3c8bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:12.643886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7bcc85c4-9488-441e-80c7-4c06e3c8bcb9 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:12.645142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7bcc85c4-9488-441e-80c7-4c06e3c8bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:12.654465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:12.692554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab875-3acb-4215-8142-b2021c7ae37a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:12.706611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab875-3acb-4215-8142-b2021c7ae37a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:12.711017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:12.711655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:12.711973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:12.712273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:12.722012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:12.723460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7160d-09b7-4eff-84ad-d1b3773fa6dc service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:12.733512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 734/1455] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:15.005603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe291d9-46dd-4ae5-8012-f2db155f895c None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:15.006184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe291d9-46dd-4ae5-8012-f2db155f895c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:15.006184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe291d9-46dd-4ae5-8012-f2db155f895c None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:15.007540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:15.014037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf474-f5ec-4f1d-be84-3831ea926a02 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:15.014861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf474-f5ec-4f1d-be84-3831ea926a02 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:15.015029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf474-f5ec-4f1d-be84-3831ea926a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:15.040066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c8bcf474-f5ec-4f1d-be84-3831ea926a02 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:15.041250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c8bcf474-f5ec-4f1d-be84-3831ea926a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:15.049931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:15.087232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe291d9-46dd-4ae5-8012-f2db155f895c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:15.098553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe291d9-46dd-4ae5-8012-f2db155f895c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:15.102475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:15.103101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:15.103378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:15.103647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:15.113054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:15.114481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08613-8a75-487b-a9e7-a4abe70c7011 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:15.123716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 723/1458] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:47:17.408244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703a06-d5f7-469e-900f-3012224865bd None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:17.408845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703a06-d5f7-469e-900f-3012224865bd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:17.408845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703a06-d5f7-469e-900f-3012224865bd None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:17.410126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:17.419300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882e4f-1b61-4f41-8c9a-e11746666fd0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:17.419751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882e4f-1b61-4f41-8c9a-e11746666fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:17.419888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882e4f-1b61-4f41-8c9a-e11746666fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:17.441143 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d5882e4f-1b61-4f41-8c9a-e11746666fd0 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:17.442333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d5882e4f-1b61-4f41-8c9a-e11746666fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:17.453717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:17.494514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64703a06-d5f7-469e-900f-3012224865bd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:17.514161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64703a06-d5f7-469e-900f-3012224865bd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:17.520566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:17.521235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:17.521517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:17.521792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:17.540148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:17.541595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513241e7-78a2-4c82-9725-7fa91e456073 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:17.555946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 737/1461] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:19.838568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda7da-e017-42ea-8135-2b2a10141803 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:19.839151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda7da-e017-42ea-8135-2b2a10141803 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:19.839151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda7da-e017-42ea-8135-2b2a10141803 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:19.840818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:19.846279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc542f-6e16-4e67-8354-fc8a059dea66 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:19.846732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc542f-6e16-4e67-8354-fc8a059dea66 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:19.846843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc542f-6e16-4e67-8354-fc8a059dea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:19.866692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3efc542f-6e16-4e67-8354-fc8a059dea66 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:19.867904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3efc542f-6e16-4e67-8354-fc8a059dea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:19.876468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:19.913795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cda7da-e017-42ea-8135-2b2a10141803 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:19.926297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cda7da-e017-42ea-8135-2b2a10141803 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:19.931104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:19.931733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:19.932053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:19.932324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:19.941673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:19.943100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd294595-ef6b-44d1-b2c9-b6d5780d282f service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:19.952297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 726/1464] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:22.175115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78d8a-1bfe-4ed8-a812-db33475bee5e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:22.176112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78d8a-1bfe-4ed8-a812-db33475bee5e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:22.176112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78d8a-1bfe-4ed8-a812-db33475bee5e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:22.177208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:22.182747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a333b-6af7-4f2a-b061-ef145ffaef02 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:22.183437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a333b-6af7-4f2a-b061-ef145ffaef02 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:22.183437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a333b-6af7-4f2a-b061-ef145ffaef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:22.202294 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b26a333b-6af7-4f2a-b061-ef145ffaef02 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:22.203468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b26a333b-6af7-4f2a-b061-ef145ffaef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:22.211975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:22.248740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78d8a-1bfe-4ed8-a812-db33475bee5e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:22.261969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78d8a-1bfe-4ed8-a812-db33475bee5e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:22.266607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:22.267236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:22.267496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:22.267784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:22.277515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:22.278948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f001-6900-4c7d-a04a-2747dcb656d3 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:22.288200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 740/1467] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:24.516008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28824-9938-4c8f-80ab-997603198864 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:24.516544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28824-9938-4c8f-80ab-997603198864 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:24.516544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28824-9938-4c8f-80ab-997603198864 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:24.517877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:24.524279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f0f3-ad85-4229-9b0b-a7e2ac89fb31 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:24.524995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f0f3-ad85-4229-9b0b-a7e2ac89fb31 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:24.525147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f0f3-ad85-4229-9b0b-a7e2ac89fb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:24.547078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b6f8f0f3-ad85-4229-9b0b-a7e2ac89fb31 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:24.548316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b6f8f0f3-ad85-4229-9b0b-a7e2ac89fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:24.556793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:24.592806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28824-9938-4c8f-80ab-997603198864 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:24.608724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28824-9938-4c8f-80ab-997603198864 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:24.615830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:24.616787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:24.617182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:24.617511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:24.630920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:24.632490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9794-0fcf-404e-a5df-08275616b1a9 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:24.642114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 729/1470] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:47:57.645260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60890-fbdf-4f9d-9320-f003bb3a2833 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:57.645911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60890-fbdf-4f9d-9320-f003bb3a2833 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:57.645911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60890-fbdf-4f9d-9320-f003bb3a2833 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:57.647179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 742/1471] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:57.653334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb107f-0e4f-43a8-b794-08857262ded6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:57.653820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb107f-0e4f-43a8-b794-08857262ded6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:57.653916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb107f-0e4f-43a8-b794-08857262ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:57.673346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bebb107f-0e4f-43a8-b794-08857262ded6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:57.674514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bebb107f-0e4f-43a8-b794-08857262ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:57.683489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 730/1472] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:57.729868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0a3c9-96fe-4d9e-b3d3-a75f75cbb796 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:57.730274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0a3c9-96fe-4d9e-b3d3-a75f75cbb796 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:57.730403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0a3c9-96fe-4d9e-b3d3-a75f75cbb796 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:57.731741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 743/1473] 10.222.0.11 () {54 vars in 962 bytes} [Tue May 3 08:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:47:57.737610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671dba2-d57d-42ff-a12c-1c98729a7b02 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:57.737895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671dba2-d57d-42ff-a12c-1c98729a7b02 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:57.738136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671dba2-d57d-42ff-a12c-1c98729a7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:57.755695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8671dba2-d57d-42ff-a12c-1c98729a7b02 None None] MFA Rules not processed for user `45dbe9ca0c3f4d37906a4a42c6e45545`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:47:57.756878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8671dba2-d57d-42ff-a12c-1c98729a7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:47:57.763540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 731/1474] 10.222.0.11 () {58 vars in 1059 bytes} [Tue May 3 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:47:57.771041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0a3c9-96fe-4d9e-b3d3-a75f75cbb796 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:47:57.783457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0a3c9-96fe-4d9e-b3d3-a75f75cbb796 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:47:57.787866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:47:57.788487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:47:57.789041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:47:57.789307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:47:57.798844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:47:57.800218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abf1f6-c2cd-457f-96f8-f87c511d0511 service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:47:57.810180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 744/1475] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:48:00.104757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfff4d-e104-49af-a35f-034887a296e1 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:00.105588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfff4d-e104-49af-a35f-034887a296e1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:00.105588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfff4d-e104-49af-a35f-034887a296e1 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:00.107655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 732/1476] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:00.114239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694384-808d-42ba-a28e-48e21ed3e28d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:00.114945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694384-808d-42ba-a28e-48e21ed3e28d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:00.115036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694384-808d-42ba-a28e-48e21ed3e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:00.137496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a7694384-808d-42ba-a28e-48e21ed3e28d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:00.138703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a7694384-808d-42ba-a28e-48e21ed3e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:00.146884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 745/1477] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:48:00.169595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfff4d-e104-49af-a35f-034887a296e1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:00.182677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfff4d-e104-49af-a35f-034887a296e1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:00.187623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:00.188295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:00.188576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:00.188847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:00.189675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:00.191509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:48:00.191509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:48:00.191509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:48:00.192711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57286cf6-812d-4f6c-bd6f-1ccf88d14b8d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:00.211727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 733/1478] 10.222.0.11 () {56 vars in 1108 bytes} [Tue May 3 08:48:00 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:48:02.506616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadc34-bf6f-4fe5-8edd-ccea5d0f6b38 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:02.507166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadc34-bf6f-4fe5-8edd-ccea5d0f6b38 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:02.507166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadc34-bf6f-4fe5-8edd-ccea5d0f6b38 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:02.508480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 746/1479] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:02.514786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cb19-5699-4ec6-b26e-aa664d8ef915 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:02.515553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cb19-5699-4ec6-b26e-aa664d8ef915 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:02.515727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cb19-5699-4ec6-b26e-aa664d8ef915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:02.536060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b8f1cb19-5699-4ec6-b26e-aa664d8ef915 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:02.537349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b8f1cb19-5699-4ec6-b26e-aa664d8ef915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:02.548772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 734/1480] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:48:02.611284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadc34-bf6f-4fe5-8edd-ccea5d0f6b38 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:02.626673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadc34-bf6f-4fe5-8edd-ccea5d0f6b38 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:02.632406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:02.633074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:02.633349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:02.633628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:02.641624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:02.643280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456a8ed-a9cb-4a1c-8af6-5f457b12f8cc service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:02.652562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 747/1481] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:48:05.046426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8243d4-b937-49ec-a304-5e751c86c069 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:05.047348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8243d4-b937-49ec-a304-5e751c86c069 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:05.047348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8243d4-b937-49ec-a304-5e751c86c069 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:05.049810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 735/1482] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:05.058370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5850f-c957-4cdb-a18c-1861ac27f4e1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:05.059147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5850f-c957-4cdb-a18c-1861ac27f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:05.059341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5850f-c957-4cdb-a18c-1861ac27f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:05.079808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d5a5850f-c957-4cdb-a18c-1861ac27f4e1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:05.081044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d5a5850f-c957-4cdb-a18c-1861ac27f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:05.090314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 748/1483] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:48:05.126203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8243d4-b937-49ec-a304-5e751c86c069 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:05.138513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8243d4-b937-49ec-a304-5e751c86c069 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:05.144292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:05.145203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:05.145490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:05.145756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:05.160032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:05.161481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bcb70-814d-48cd-93f4-a268f33b277d service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:05.171207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 736/1484] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:48:07.449097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73258-08b3-4d3c-816d-cea4c445f459 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:07.449741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73258-08b3-4d3c-816d-cea4c445f459 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:07.449741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73258-08b3-4d3c-816d-cea4c445f459 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:07.451044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 749/1485] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:07.459657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127e1a-fd79-4d8a-adcd-976107f268f1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:07.460676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127e1a-fd79-4d8a-adcd-976107f268f1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:07.460676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127e1a-fd79-4d8a-adcd-976107f268f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:07.484640 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-79127e1a-fd79-4d8a-adcd-976107f268f1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:07.485860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-79127e1a-fd79-4d8a-adcd-976107f268f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:07.494959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 737/1486] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:48:07.532395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73258-08b3-4d3c-816d-cea4c445f459 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:07.544450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73258-08b3-4d3c-816d-cea4c445f459 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:07.548605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:07.549239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:07.549558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:07.549832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:07.559047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:07.560529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eb07f-149d-4578-a2d0-17b292bc8254 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:07.570185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 750/1487] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:48:09.875822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ee02-69df-43e3-82c4-43a133caa7dc None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:09.876422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ee02-69df-43e3-82c4-43a133caa7dc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:09.876422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ee02-69df-43e3-82c4-43a133caa7dc None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:09.877821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 738/1488] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:09.884020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad318fd-c2a2-4d53-ab4b-1b990350b904 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:09.884496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad318fd-c2a2-4d53-ab4b-1b990350b904 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:09.884617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad318fd-c2a2-4d53-ab4b-1b990350b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:09.902630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bad318fd-c2a2-4d53-ab4b-1b990350b904 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:09.903805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bad318fd-c2a2-4d53-ab4b-1b990350b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:09.912161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 751/1489] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:48:09.951884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ee02-69df-43e3-82c4-43a133caa7dc None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:09.965284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ee02-69df-43e3-82c4-43a133caa7dc None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:09.969502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:09.970158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:09.970433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:09.970721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:09.980679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:09.982102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e7b0-6157-4531-ab77-cd9338007a78 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:09.992355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 739/1490] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:48:12.377613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364287-e993-45fa-b86f-859578a5f0fe None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:12.378058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364287-e993-45fa-b86f-859578a5f0fe None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:12.378163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364287-e993-45fa-b86f-859578a5f0fe None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:12.380421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 752/1491] 10.222.0.11 () {54 vars in 926 bytes} [Tue May 3 08:48:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:48:12.388526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3b7e-b1f8-49e2-b64a-058e974d387c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:12.389007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3b7e-b1f8-49e2-b64a-058e974d387c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:12.389007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3b7e-b1f8-49e2-b64a-058e974d387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:12.408479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d56c3b7e-b1f8-49e2-b64a-058e974d387c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:48:12.409666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d56c3b7e-b1f8-49e2-b64a-058e974d387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:48:12.418205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 740/1492] 10.222.0.11 () {58 vars in 1023 bytes} [Tue May 3 08:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:48:12.456547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364287-e993-45fa-b86f-859578a5f0fe None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:48:12.470391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364287-e993-45fa-b86f-859578a5f0fe None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:48:12.477260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:48:12.478217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:48:12.478581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:48:12.479010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:48:12.491014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:48:12.492582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85a4b-4c23-436d-ad04-3016dfd3e65d service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:48:12.501838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 753/1493] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:49:45.758729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:45.759665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:45.759665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:45.787569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:49:45.788809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:45.801631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 741/1494] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:49:45.813332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:45.813921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:45.814029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:45.840320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:49:45.842106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:45.852557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 754/1495] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:49:45.857131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:45.867428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5c07-cdeb-4dd2-9392-8efefc07a93c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:45.873063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:45.873728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:45.874002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:45.874275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:45.874984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:49:45.875277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:45.876405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:45.876405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:49:45.876405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:49:45.877240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:45.888870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 742/1496] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:49:45.897199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:45.906044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099b2a-7fbd-4c7c-ba37-b4610a9c7f82 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:45.910707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:45.911343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:45.911606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:45.911913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:45.912604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:45.914376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:45.914376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:49:45.914376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:49:45.915556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:45.951515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 755/1497] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:49:45 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:49:45.955858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:45.966199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa970-11e4-424a-9a3c-523664a3f66a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.026669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.027279 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.027559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.027867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.028534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.029547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:46.029547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:49:46.029547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:49:46.030747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.051526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 743/1498] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:49:45 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:49:46.055700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.065956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281cfb-a684-4019-b402-507dcda34667 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.070874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.071528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.071834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.072114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.072832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.073840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:46.073840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:49:46.073840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:49:46.074711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.087839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 756/1499] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:49:46.091914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.102702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bed1f-150e-40cc-a3d4-59ee01b6244c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.109471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.110128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.110500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.110774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.111497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.112549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:46.112549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:49:46.112549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:49:46.113426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78d0d8-5662-46d5-8106-69f8bc56bba1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.127085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 744/1500] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:49:46.131266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.141655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81af3e-4b10-4338-adb0-52d85adb5f18 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.147046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.147973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.148253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.148531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] PATH_INFO: `/v3/projects/734ebe132af04788ac826fbbfb8c82f0/users/9b4349e0390c4876aa0ae6a4b4e77b06/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.165350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734ebe132af04788ac826fbbfb8c82f0, user_id=9b4349e0390c4876aa0ae6a4b4e77b06, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.166394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:46.166394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:49:46.166394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:49:46.168396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.184131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 757/1501] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:49:46 2022] PUT /identity/v3/projects/734ebe132af04788ac826fbbfb8c82f0/users/9b4349e0390c4876aa0ae6a4b4e77b06/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:49:46.195656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3374-3366-46da-baa1-bf89f9eb4a20 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.195973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3374-3366-46da-baa1-bf89f9eb4a20 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.196249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3374-3366-46da-baa1-bf89f9eb4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.224438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6fea3374-3366-46da-baa1-bf89f9eb4a20 None None] MFA Rules not processed for user `9b4349e0390c4876aa0ae6a4b4e77b06`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:49:46.225660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6fea3374-3366-46da-baa1-bf89f9eb4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:46.297535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 745/1502] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:49:46.308684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.379816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b95691-da47-4279-8a71-c8141187cef6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.386370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.386998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.387276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.387549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.395583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.397186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.408155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 758/1503] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:49:46.480775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1e5c-c45c-4fee-a5aa-31691e2fcdd7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.481060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1e5c-c45c-4fee-a5aa-31691e2fcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.481364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1e5c-c45c-4fee-a5aa-31691e2fcdd7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.482718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 746/1504] 10.222.0.11 () {52 vars in 829 bytes} [Tue May 3 08:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:49:46.487209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.553297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a15-530f-46f3-8dee-9771965da069 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.558756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.559653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.559988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.560265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] PATH_INFO: `/v3/users/9b4349e0390c4876aa0ae6a4b4e77b06` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.561609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4349e0390c4876aa0ae6a4b4e77b06)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.562631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:46.562631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:49:46.562631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:49:46.563944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.633272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4349e0390c4876aa0ae6a4b4e77b06'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:46.644821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4349e0390c4876aa0ae6a4b4e77b06'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:46.656722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4349e0390c4876aa0ae6a4b4e77b06'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:46.657428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4349e0390c4876aa0ae6a4b4e77b06'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:46.658137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4349e0390c4876aa0ae6a4b4e77b06'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:46.681991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 759/1505] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:49:46 2022] DELETE /identity/v3/users/9b4349e0390c4876aa0ae6a4b4e77b06 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:49:46.686521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.686810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.687084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.705683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:49:46.706844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:46.766154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 747/1506] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:49:46.776512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:46.778087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:46.835000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7356f77-3f3a-4505-8c23-488806cb0e1c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:46.838738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:46.839381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:46.839664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:46.839965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:46.848844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:46.850277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3feca-ad8d-4ca2-a2a5-eba27165f63b service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:46.859976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 760/1507] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:49:47.206256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:49:47.207784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:49:47.228897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c525cd-c920-456c-b3e9-4ec9dd7cd872 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:49:47.235559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:49:47.237584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:49:47.237941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:49:47.238885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] PATH_INFO: `/v3/projects/734ebe132af04788ac826fbbfb8c82f0` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:49:47.240389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734ebe132af04788ac826fbbfb8c82f0)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:49:47.241718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:49:47.241718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:49:47.241718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:49:47.243471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:49:47.303624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734ebe132af04788ac826fbbfb8c82f0', 'request_id': 'req-2a73583c-86b1-452b-b451-01b9776259d1'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:47.314371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734ebe132af04788ac826fbbfb8c82f0', 'request_id': 'req-2a73583c-86b1-452b-b451-01b9776259d1'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:47.320257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734ebe132af04788ac826fbbfb8c82f0', 'request_id': 'req-2a73583c-86b1-452b-b451-01b9776259d1'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:47.338332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] The token cache is being invalidate because project 734ebe132af04788ac826fbbfb8c82f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:49:47.338612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:47.339256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2a73583c-86b1-452b-b451-01b9776259d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:49:47.342220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 748/1508] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:49:47 2022] DELETE /identity/v3/projects/734ebe132af04788ac826fbbfb8c82f0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:51:32.078502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:32.079197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:32.079197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:32.080520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 761/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:32.086761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1893-eb4c-42fc-8b7b-19e7b72a76d5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:32.087689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1893-eb4c-42fc-8b7b-19e7b72a76d5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:32.087689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1893-eb4c-42fc-8b7b-19e7b72a76d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:32.110958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-fdfa1893-eb4c-42fc-8b7b-19e7b72a76d5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:32.112258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fdfa1893-eb4c-42fc-8b7b-19e7b72a76d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:32.176570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 749/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:32.332520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:32.334325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:32.348627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd3530-653f-451c-a5a4-849baaa789c9 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:32.349132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd3530-653f-451c-a5a4-849baaa789c9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:32.349252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd3530-653f-451c-a5a4-849baaa789c9 None None] PATH_INFO: `/v3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:32.350791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 750/1511] 10.222.0.21 () {54 vars in 925 bytes} [Tue May 3 08:51:32 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:51:32.357922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e16d-d093-4239-9e24-97c06c5e7c24 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:32.358201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e16d-d093-4239-9e24-97c06c5e7c24 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:32.358910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e16d-d093-4239-9e24-97c06c5e7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:32.383091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9f53e16d-d093-4239-9e24-97c06c5e7c24 None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:32.384392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9f53e16d-d093-4239-9e24-97c06c5e7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:32.415401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1afa8b-b0ce-4844-8be9-d12a3a051640 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:32.422059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:32.422714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:32.422993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:32.423267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:32.431640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:32.433282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d728be-00ea-4691-83f4-de51dcd61ab1 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:32.443476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 762/1512] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:51:32.449352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 751/1513] 10.222.0.21 () {58 vars in 1015 bytes} [Tue May 3 08:51:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:51:33.667337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567c5c-91ff-41d9-afc0-449d133e3f79 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:33.667932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567c5c-91ff-41d9-afc0-449d133e3f79 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:33.667932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567c5c-91ff-41d9-afc0-449d133e3f79 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:33.669353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:33.675321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af4d8-fc51-4da9-9bea-93da87e142f4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:33.676020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af4d8-fc51-4da9-9bea-93da87e142f4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:33.676131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af4d8-fc51-4da9-9bea-93da87e142f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:33.697966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9a6af4d8-fc51-4da9-9bea-93da87e142f4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:33.699208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9a6af4d8-fc51-4da9-9bea-93da87e142f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:33.708814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:33.863086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567c5c-91ff-41d9-afc0-449d133e3f79 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:33.878815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567c5c-91ff-41d9-afc0-449d133e3f79 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:33.884901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:33.885536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:33.885819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:33.886091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:33.894364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:33.895986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479659-52fe-4459-9f9b-aec7cbce860f service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:33.905419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 764/1516] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:51:36.357422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416929-24cd-4f51-845d-a9fb6deb1a6e None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:36.358528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416929-24cd-4f51-845d-a9fb6deb1a6e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:36.358641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416929-24cd-4f51-845d-a9fb6deb1a6e None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:36.360128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 753/1517] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:36.368361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ce71-dac6-4981-8683-e1542a8405e9 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:36.368847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ce71-dac6-4981-8683-e1542a8405e9 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:36.368956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ce71-dac6-4981-8683-e1542a8405e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:36.394584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7ef5ce71-dac6-4981-8683-e1542a8405e9 None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:36.395810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7ef5ce71-dac6-4981-8683-e1542a8405e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:36.405489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 765/1518] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:51:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:36.412986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51416929-24cd-4f51-845d-a9fb6deb1a6e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:36.426553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51416929-24cd-4f51-845d-a9fb6deb1a6e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:36.431496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:36.432153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:36.432431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:36.432835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:36.440928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:36.442514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ccb2a-8876-4731-936f-9fd354486a9e service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:36.451998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 754/1519] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:51:45.535310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7cdae-063f-4494-9083-800b5e8c0163 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:45.535943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7cdae-063f-4494-9083-800b5e8c0163 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:45.535943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7cdae-063f-4494-9083-800b5e8c0163 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:45.537170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 766/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:45.542067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e64-fcb5-4970-b383-a60390418b07 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:45.542496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e64-fcb5-4970-b383-a60390418b07 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:45.542627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e64-fcb5-4970-b383-a60390418b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:45.562345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a53c7e64-fcb5-4970-b383-a60390418b07 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:45.563523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a53c7e64-fcb5-4970-b383-a60390418b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:45.572098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 755/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:45.724445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7cdae-063f-4494-9083-800b5e8c0163 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:45.745362 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7cdae-063f-4494-9083-800b5e8c0163 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:45.753212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:45.754037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:45.754317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:45.754590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:45.766857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:45.769010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580616f-25be-409c-ae2a-744a117ab721 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:45.778671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 767/1522] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:51:47.000303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a51b6c-5190-41c5-8f9a-dd4283a3bfec None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:47.001003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a51b6c-5190-41c5-8f9a-dd4283a3bfec None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:47.001003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a51b6c-5190-41c5-8f9a-dd4283a3bfec None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:47.002912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 756/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 08:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:47.007998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715cac-fbad-4894-95eb-493f1a856ca3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:47.008504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715cac-fbad-4894-95eb-493f1a856ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:47.008504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715cac-fbad-4894-95eb-493f1a856ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:47.028431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a8715cac-fbad-4894-95eb-493f1a856ca3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:47.029669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a8715cac-fbad-4894-95eb-493f1a856ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:47.039744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 768/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 08:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:47.190050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a51b6c-5190-41c5-8f9a-dd4283a3bfec None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:47.212785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a51b6c-5190-41c5-8f9a-dd4283a3bfec None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:47.219030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:47.219698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:47.220025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:47.220291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:47.229572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:47.231185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307bc58-b2e1-460f-bb6d-ff23c26eabb7 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:47.242214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 757/1525] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:51:51.371461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:51.372555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:51.372555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:51.374662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 769/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:51.383344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7ad2-fe5a-4fe8-980f-67e07d2f99f6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:51.383821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7ad2-fe5a-4fe8-980f-67e07d2f99f6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:51.383998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7ad2-fe5a-4fe8-980f-67e07d2f99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:51.407063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-038b7ad2-fe5a-4fe8-980f-67e07d2f99f6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:51.408283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-038b7ad2-fe5a-4fe8-980f-67e07d2f99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:51.416972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 758/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:51.452890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:51.455142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:51.525857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fdd2b-46ef-4618-a03f-08d4bb9558a4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:51.530492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:51.531135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:51.531408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:51.531676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:51.541106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:51.542536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387ebca-a340-4169-b28d-3a638754bf39 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:51.552259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 770/1528] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:51:53.780861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:53.781491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:53.781491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:53.782787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 759/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:53.788255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac94e-658b-42c4-9a4b-0ad177ab5d48 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:53.788717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac94e-658b-42c4-9a4b-0ad177ab5d48 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:53.788822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac94e-658b-42c4-9a4b-0ad177ab5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:53.807814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2c9ac94e-658b-42c4-9a4b-0ad177ab5d48 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:53.809022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2c9ac94e-658b-42c4-9a4b-0ad177ab5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:53.817314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 771/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:53.855876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:53.857777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:53.872011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d3b50-cc86-4205-b239-a26b64644156 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:53.875970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:53.876604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:53.876865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:53.877160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:53.886364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:53.887809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a70f5-32ac-4688-884a-88b1b392a805 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:53.897098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 760/1531] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:51:57.760552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:57.761122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:57.761122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:57.762584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 772/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:51:57.771012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71e7e-eb08-4b62-826f-ffa80408ef5a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:57.771442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71e7e-eb08-4b62-826f-ffa80408ef5a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:57.771572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71e7e-eb08-4b62-826f-ffa80408ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:57.793653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-aaf71e7e-eb08-4b62-826f-ffa80408ef5a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:51:57.794848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-aaf71e7e-eb08-4b62-826f-ffa80408ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:57.803655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 761/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:51:58.070187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:51:58.072345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:51:58.142487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e54a3-1d8a-4957-a7cc-508612e761e3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:51:58.146875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:51:58.147512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:51:58.147790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:51:58.148123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:51:58.157789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:51:58.159215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17958ff7-386b-419a-8821-f874d563de3c service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:51:58.169851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 773/1534] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:52:00.418301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f059-3ad5-4938-a037-b88a1a6a6688 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:52:00.418902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f059-3ad5-4938-a037-b88a1a6a6688 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:52:00.418902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f059-3ad5-4938-a037-b88a1a6a6688 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:52:00.420275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 762/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 08:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:52:00.425729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddf78-27a7-4e08-a660-b66d1345ad30 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:52:00.426187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddf78-27a7-4e08-a660-b66d1345ad30 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:52:00.426291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddf78-27a7-4e08-a660-b66d1345ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:52:00.445986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-920ddf78-27a7-4e08-a660-b66d1345ad30 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:52:00.447172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-920ddf78-27a7-4e08-a660-b66d1345ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:52:00.455958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 774/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:52:00.724286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f2cf-8960-4a37-91c8-799786f1aa0b None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:52:00.724781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f2cf-8960-4a37-91c8-799786f1aa0b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:52:00.725230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f2cf-8960-4a37-91c8-799786f1aa0b None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:52:00.727520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 763/1537] 10.222.0.11 () {54 vars in 963 bytes} [Tue May 3 08:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:52:00.732706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe59d-f759-47e4-91f1-b0ac7e40e6e7 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:52:00.733341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe59d-f759-47e4-91f1-b0ac7e40e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:52:00.733618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe59d-f759-47e4-91f1-b0ac7e40e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:52:00.752292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a2fbe59d-f759-47e4-91f1-b0ac7e40e6e7 None None] MFA Rules not processed for user `1d44d26a512a4a92806e60f3cb10dd33`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:52:00.753450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a2fbe59d-f759-47e4-91f1-b0ac7e40e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:52:00.760942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 775/1538] 10.222.0.11 () {58 vars in 1060 bytes} [Tue May 3 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:52:00.772512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f2cf-8960-4a37-91c8-799786f1aa0b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:52:00.785880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f2cf-8960-4a37-91c8-799786f1aa0b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:52:00.789635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:52:00.790257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:52:00.790539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:52:00.790817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:52:00.799629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:52:00.801081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1165-7d1b-477b-a2ca-65b3f81232f2 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:52:00.810265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 764/1539] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:31.481420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.482077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.482077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.509930 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:31.511120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:31.523680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 776/1540] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:31.534003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.534933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.535375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.563275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:31.564798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:31.578167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 765/1541] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:31.582612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.592468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d774338-c354-4c44-ae64-46a07cc5d8fd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.603725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.604457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.604737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.605009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.605737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:31.606350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.607369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:31.607369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:53:31.607369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:53:31.608292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:31.624988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 777/1542] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:31.633333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.644032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f6d23-8e67-4e74-8aaf-7731c28147f1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.652759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.653901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.654386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.654860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.655847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.657132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:31.657132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:53:31.657132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:53:31.658862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:31.706619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 766/1543] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:31.711093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.726587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd3cb-e90e-4550-89ec-b8677e2df61f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.801095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.801694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.801978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.802415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.803108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.804157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:31.804157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:53:31.804157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:53:31.805372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:31.833693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 778/1544] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:31.837991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.862257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1c0c-fce6-4001-9db1-c156022126f8 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.873744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.874813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.875321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.875860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.876835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.878711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0fdb-dc1f-4b38-8c82-591b6fce1612 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:31.896909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 767/1545] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:31.901032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.917337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8766be-004c-4814-94ab-823a024aeea0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.921981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.922654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.922929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.923201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.923949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.924244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c837-7a1f-4ee5-9e40-86ef96ee9b81 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.924736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c837-7a1f-4ee5-9e40-86ef96ee9b81 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.925212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c837-7a1f-4ee5-9e40-86ef96ee9b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.925542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:31.937448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 779/1546] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:31.941963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:31.956083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7646c837-7a1f-4ee5-9e40-86ef96ee9b81 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:31.956909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168acd-9285-4c0a-934f-9026bf8ec03b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:31.957867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7646c837-7a1f-4ee5-9e40-86ef96ee9b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:31.961630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:31.962620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.962969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.963242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] PATH_INFO: `/v3/projects/b9cfd646709540a4a85c64b7aeb5a523/users/f315597388e14d6ca2ffa1397d94fa25/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.977580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 768/1547] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:53:31.979305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2514-baad-48f5-bc5b-fe1042222015 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:31.979815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2514-baad-48f5-bc5b-fe1042222015 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:31.980312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2514-baad-48f5-bc5b-fe1042222015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:31.983549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cfd646709540a4a85c64b7aeb5a523, user_id=f315597388e14d6ca2ffa1397d94fa25, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:31.986349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ecfe-8dfd-4395-9ad4-615e968809ab admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.011345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 780/1548] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:31 2022] PUT /identity/v3/projects/b9cfd646709540a4a85c64b7aeb5a523/users/f315597388e14d6ca2ffa1397d94fa25/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:32.012684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4d50-ebba-4b97-97d6-43175427837b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.012968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4d50-ebba-4b97-97d6-43175427837b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.013238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4d50-ebba-4b97-97d6-43175427837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.021315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-cc0b2514-baad-48f5-bc5b-fe1042222015 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.022527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cc0b2514-baad-48f5-bc5b-fe1042222015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.034200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1bdd4d50-ebba-4b97-97d6-43175427837b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.035376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1bdd4d50-ebba-4b97-97d6-43175427837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.094890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 769/1549] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.096257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45732-c957-4d38-9d8d-6ea857e5e8c3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.096546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45732-c957-4d38-9d8d-6ea857e5e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.096819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45732-c957-4d38-9d8d-6ea857e5e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.104297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 781/1550] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.107808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee97f-2b42-4947-9756-191ff2e2027c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.107808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee97f-2b42-4947-9756-191ff2e2027c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.107808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee97f-2b42-4947-9756-191ff2e2027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.119393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-67b45732-c957-4d38-9d8d-6ea857e5e8c3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.120643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-67b45732-c957-4d38-9d8d-6ea857e5e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.123739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ee2ee97f-2b42-4947-9756-191ff2e2027c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.124925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ee2ee97f-2b42-4947-9756-191ff2e2027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.131878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 770/1551] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.131878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efa3e-9e16-4aad-8ad1-a18306ab2bb7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.131878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efa3e-9e16-4aad-8ad1-a18306ab2bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.131878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efa3e-9e16-4aad-8ad1-a18306ab2bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.135829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 782/1552] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.137312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4e80-47dc-40ce-b12d-10160d59248c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.137618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4e80-47dc-40ce-b12d-10160d59248c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.137879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4e80-47dc-40ce-b12d-10160d59248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.148229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c79efa3e-9e16-4aad-8ad1-a18306ab2bb7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.149403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c79efa3e-9e16-4aad-8ad1-a18306ab2bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.155524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2d9b4e80-47dc-40ce-b12d-10160d59248c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.156736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2d9b4e80-47dc-40ce-b12d-10160d59248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.157026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 771/1553] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.158220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcad0c-e6ab-43fd-9ad4-ff7d474f1098 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.158503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcad0c-e6ab-43fd-9ad4-ff7d474f1098 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.158773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcad0c-e6ab-43fd-9ad4-ff7d474f1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.168655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 783/1554] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.169927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e935-2a7d-498e-a744-f36ea3958f2c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.170217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e935-2a7d-498e-a744-f36ea3958f2c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.170498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e935-2a7d-498e-a744-f36ea3958f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.176287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-39dcad0c-e6ab-43fd-9ad4-ff7d474f1098 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.177465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-39dcad0c-e6ab-43fd-9ad4-ff7d474f1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.185356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 772/1555] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.186619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.186901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.187172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.191806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8ab8e935-2a7d-498e-a744-f36ea3958f2c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.193356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8ab8e935-2a7d-498e-a744-f36ea3958f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.205094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.205373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 784/1556] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.206542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.206658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa753e-ef6e-4dfd-904b-ee8b16ec04d8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.206912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa753e-ef6e-4dfd-904b-ee8b16ec04d8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.207185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa753e-ef6e-4dfd-904b-ee8b16ec04d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.214369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 773/1557] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.214369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.225719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadd2ca-5536-4c2c-9fc6-eb6e4f427d66 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.231454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.232148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.232427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.232697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.233415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.233657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-aeaa753e-ef6e-4dfd-904b-ee8b16ec04d8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.233786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.235155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aeaa753e-ef6e-4dfd-904b-ee8b16ec04d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.235358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.245709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 785/1558] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.247505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55480-5628-481a-ad3b-e78807534fd3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.248004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55480-5628-481a-ad3b-e78807534fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.248466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55480-5628-481a-ad3b-e78807534fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.256212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 774/1559] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.257870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.272804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e0a55480-5628-481a-ad3b-e78807534fd3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.274282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e0a55480-5628-481a-ad3b-e78807534fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.282399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 786/1560] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.284053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f664f-c62a-4efd-bfef-1d4903d8ce6a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.284346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f664f-c62a-4efd-bfef-1d4903d8ce6a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.284631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f664f-c62a-4efd-bfef-1d4903d8ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.303506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c74f664f-c62a-4efd-bfef-1d4903d8ce6a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.304743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c74f664f-c62a-4efd-bfef-1d4903d8ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.312606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 787/1561] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.315966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a92a-55d2-4f35-8ae0-69d0ca8af6ed None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.315966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a92a-55d2-4f35-8ae0-69d0ca8af6ed None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.315966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a92a-55d2-4f35-8ae0-69d0ca8af6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.316988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f79a-ce0a-40c7-a5c6-10c5d972f42b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.320738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.321392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.321698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.321973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.331939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.332725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5f82a92a-55d2-4f35-8ae0-69d0ca8af6ed None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.333388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.333900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5f82a92a-55d2-4f35-8ae0-69d0ca8af6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.341648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 788/1562] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.342907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.343114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 775/1563] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:32.343230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.343466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.343948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.354444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b628-b353-4614-963d-e94697e35230 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.360887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.361543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.361658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:32.361871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.362951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.363092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:32.363580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.363914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.366159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.376764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 789/1564] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:32.382724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.384771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 776/1565] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.393436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.393571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89fcac-0bf5-4bce-a772-2535244301f4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.398685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.399356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.399636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.399945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.400733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.401040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.402831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.405560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056551-aac0-4d84-bbfc-e6a663f195b9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.410412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.411077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.411356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.411641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.412377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.414459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.416120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 790/1566] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.417121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.428839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5260-7c4f-4418-9bec-b02a1295efc8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.434596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.435469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.435753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.436056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.436920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.437139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.439217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.453979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 777/1567] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.453979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.462828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 791/1568] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.462828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.468211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17970d-7980-4239-906a-7a9b61b63353 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.532213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.532803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.533081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.533356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.534080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.534429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.536594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.537908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247aa8e-ed2f-4c1f-a892-8e9bcd613108 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.542579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.543250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.543537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.543842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.544611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.544867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.546464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.557307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 792/1569] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.557307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.565523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 778/1570] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.565523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.566085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe02bb-1b38-426c-a82f-22dbecf1569f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.569709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.570388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.570671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.570944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.571663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:32.572005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.573757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.575940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a7e7-ee60-4a1f-ad8a-febf591508a9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.580668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.581340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.581625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.581902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.582597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.584617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.588464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 793/1571] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:32.589542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.600637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0da1c4-cda7-4def-b4a1-bc5e2051d7b9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.605594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.606650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.607087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.607371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.608105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.610080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.625863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 779/1572] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.627279 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.639433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 794/1573] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.640787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.697739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c77-d418-4932-8009-2373fb96e692 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.702657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.703405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.703817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.704173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.704930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.706143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8aeee-715e-4007-8370-0a7ee43c2869 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.707024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.711340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.712017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.712300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.712576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.713376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.715299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.734923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 780/1574] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.734923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.744708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a907fd-2aae-4d9a-aeba-5c6bde445057 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.750323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.751321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.751605 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.752075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.755547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 795/1575] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.755691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.755839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.755944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.808305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 781/1576] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.808305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.825217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cec2b-dc5c-4ad3-997e-653d05b6ffcf admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.887150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b272b-212d-47b1-8379-65704f371c47 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.890714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.891537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.891791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.892205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.892317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.892902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.893014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:32.893255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:32.893771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:32.894512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:32.895100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.896612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:32.925190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 796/1577] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.925412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 782/1578] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:32.928977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.930067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:32.993077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ba55-4274-4167-92b4-274f0ac1f0c0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:32.998869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:32.999578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.000006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.000281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.000976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.001519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a653-4f59-47f7-a3d4-16da4cf09b62 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.002939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.006198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.006864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.007146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.007442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.008119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.010119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.025006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 797/1579] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.025574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.034303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 783/1580] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:32 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.034746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d5e4-0fb5-410c-896c-523e2e5d0f67 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.037893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.039396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.040087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.040369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.040648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.041442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.043034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.048905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c404-75f2-47cb-866a-dee0e3ec6886 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.053841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.054494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.054729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 798/1581] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.054851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.055300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.055536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.056032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.058599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.077083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8bdb-4b99-47f2-9a1c-34a86da5b882 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.083689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.084489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.085643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.085643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.085883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.088740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.096067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 784/1582] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.097483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.121239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 799/1583] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.122156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.126815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c04ea-804d-4dfa-a7e2-c31e48855566 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.132814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.133730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bb221-85b1-481b-8920-ff4723c2d2d2 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.134124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.134470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.135370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.136114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.138872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.147837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.147837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.147837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.147837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.148310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.148310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.170318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 800/1584] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.170318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.170647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 785/1585] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/users => generated 295 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:33.170647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.180545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8061af2-e1bf-4d89-bddd-9b20c345d8d9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.180712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689419a-c210-47d6-bc9a-6db4bac3b50c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.185468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.186011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.186281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.186624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.186749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.186932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.187073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.187184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.187961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.188088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.189555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.189692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.200629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 786/1586] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.201588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.205092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 801/1587] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.206853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.212170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935f84-dc5c-4c3a-bfd2-4d0bce9dd4e6 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.217314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.218014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.218346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.218666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.218843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d3e9-a8a0-401d-b3ec-ea6083ff1962 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.219390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.221022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.224438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.225099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.225382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.225656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.228115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.229915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c33a3-7831-4ab2-84fe-bb11312b8282 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.231616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 787/1588] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.232416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.242164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111250-96ff-4a60-8446-8e0da3b66611 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.246948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.247574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.247881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.248157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.248874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.250006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 802/1589] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.250657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.251394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.251667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.251977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.261925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 788/1590] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.262826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.280362 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e069df-3322-4da2-afba-4906375a7c6d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.284938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] MFA Rules not processed for user `f315597388e14d6ca2ffa1397d94fa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:33.285712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.286375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:33.286502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.286697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.286927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.287650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.289289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.300015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 789/1591] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.300015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.313083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84452-c228-4b1b-b6d6-a82a1fc8cbd3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.317719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.318383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.318666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.318938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.319654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.321315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.331639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 790/1592] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.332346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.341830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdda869-f564-4113-a05e-ec50b8ba46a4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.347069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.347736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.348054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.348327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.349051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.350654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.364751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 803/1593] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:33.364751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.365053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 791/1594] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.365053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.368608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bfa8-cfff-4ca6-a41d-cf0508464400 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.372304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15304a2e-1504-4e39-a1fd-8f675940e96e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.373402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.374064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.374344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.374620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.375342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.376849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.376991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.377711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.377988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.378260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] PATH_INFO: `/v3/projects/d9159d65c5ca43edadaa60281f20c2ae/users/027eeadca01b4c4f93b892ef0fbcb195/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.386829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 804/1595] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.387559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.393146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9159d65c5ca43edadaa60281f20c2ae, user_id=027eeadca01b4c4f93b892ef0fbcb195, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.394218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:33.394218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:53:33.394218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:53:33.396184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.398604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d236-def0-433f-9717-41c7ccfecab3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.403423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.404111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.404393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.404664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.405375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.406974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.410492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 792/1596] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/d9159d65c5ca43edadaa60281f20c2ae/users/027eeadca01b4c4f93b892ef0fbcb195/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.411092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.420461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 805/1597] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.420461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.429861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da205-3fdd-4bd1-870a-36a63b07fd20 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.469740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcaa6e-ed4e-43b2-aa52-77e59832c1a7 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.474343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.475009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.475283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.475556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.476307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.477907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.483568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.484263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.484549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.484825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.485543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.487126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.488046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 793/1598] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.488839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.500463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 806/1599] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.500656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcbd77-75ae-484d-b14a-51d814dcfe9f admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.500769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.503140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.503821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.504129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.504404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.505116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.506732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f654d-4e90-4fff-8df7-ce085c3b1e0c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.507501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f390540-e437-47bc-93eb-1e42e0d29695 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.512191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.513050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.513329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.513598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] PATH_INFO: `/v3/projects/dd3c900a5a11493aa63f6ed8299ecbc1/users/16f1c2f508d5451fa0cb0eac827fc925/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.516980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 794/1600] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:33.518357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75a533-af9f-417e-8ca3-dc9b1ad9cc7c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.518645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75a533-af9f-417e-8ca3-dc9b1ad9cc7c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.518922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75a533-af9f-417e-8ca3-dc9b1ad9cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.531563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3c900a5a11493aa63f6ed8299ecbc1, user_id=16f1c2f508d5451fa0cb0eac827fc925, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.534260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.535946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ef75a533-af9f-417e-8ca3-dc9b1ad9cc7c None None] MFA Rules not processed for user `f315597388e14d6ca2ffa1397d94fa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:33.537186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ef75a533-af9f-417e-8ca3-dc9b1ad9cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:33.547124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 807/1601] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/dd3c900a5a11493aa63f6ed8299ecbc1/users/16f1c2f508d5451fa0cb0eac827fc925/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.548020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.592171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 795/1602] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:33.593712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.594272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.594554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.612472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:33.613655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:33.616213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e27278-b1e0-43e8-93d6-45c07f5d85e1 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.620758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.621221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 796/1603] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:33.621639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.621924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.622054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.622193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] PATH_INFO: `/v3/projects/898b965c33d64abcb120ca3f3d0b0478/users/5e139fca8faa40a68e582f54917d4237/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.631228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764cbc-9b40-4d03-9a64-b0d64c9f05e8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.635887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.636784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.637087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898b965c33d64abcb120ca3f3d0b0478, user_id=5e139fca8faa40a68e582f54917d4237, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.637202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.637319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] PATH_INFO: `/v3/projects/e1b96785b6d3430093edf139cb1e7947/users/21f56de0817749b9b85e7ad2b30440ba/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.639790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.652747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b96785b6d3430093edf139cb1e7947, user_id=21f56de0817749b9b85e7ad2b30440ba, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.653532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 808/1604] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/898b965c33d64abcb120ca3f3d0b0478/users/5e139fca8faa40a68e582f54917d4237/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.655564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.656643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.670806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 797/1605] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/e1b96785b6d3430093edf139cb1e7947/users/21f56de0817749b9b85e7ad2b30440ba/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.671550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.722363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566cd4d-6542-417a-952c-59944de75478 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.742324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf541c-0b32-488e-8dfa-95f26180cdce admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.746930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.747850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.748133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.748406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] PATH_INFO: `/v3/projects/d3ce599e490e457385310fcbca709c84/users/e6d1a1b1c3754f0d856df4ca7a8e0269/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.762750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ce599e490e457385310fcbca709c84, user_id=e6d1a1b1c3754f0d856df4ca7a8e0269, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.765480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.780000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.780887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.781165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.781437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] PATH_INFO: `/v3/projects/060b1e503fd44fb886374ccb0134a58e/users/8cbc1fc5d06c497998053e7eba822643/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.782073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 798/1606] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/d3ce599e490e457385310fcbca709c84/users/e6d1a1b1c3754f0d856df4ca7a8e0269/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.782934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.800364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060b1e503fd44fb886374ccb0134a58e, user_id=8cbc1fc5d06c497998053e7eba822643, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.803951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aec8c-e002-4036-a6ab-1add42b3eaa8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.816903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 809/1607] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/060b1e503fd44fb886374ccb0134a58e/users/8cbc1fc5d06c497998053e7eba822643/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.818287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101aad-cba3-4597-8231-c745d9f3c0f6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.818579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101aad-cba3-4597-8231-c745d9f3c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.818859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101aad-cba3-4597-8231-c745d9f3c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.844501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b7d7-5522-47b4-9335-ef6daa452a57 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:33.848325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-76101aad-cba3-4597-8231-c745d9f3c0f6 None None] MFA Rules not processed for user `16f1c2f508d5451fa0cb0eac827fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:33.849557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-76101aad-cba3-4597-8231-c745d9f3c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:33.898023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:33.898914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.899184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.899451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] PATH_INFO: `/v3/projects/fe13f4f312b145cbb904daebc75026d2/users/65620fcd12544f7094440d60b094cfb1/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.913710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe13f4f312b145cbb904daebc75026d2, user_id=65620fcd12544f7094440d60b094cfb1, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:33.915302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 810/1608] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:33.916393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddc8e-96dd-4bc1-9912-8e2aa331175d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:33.916669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d08103-06eb-49c9-9c80-31276f9833ad None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.917079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d08103-06eb-49c9-9c80-31276f9833ad None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.917359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d08103-06eb-49c9-9c80-31276f9833ad None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.918616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 811/1609] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:33.919277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d08103-06eb-49c9-9c80-31276f9833ad None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:33.930401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 799/1610] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:33 2022] PUT /identity/v3/projects/fe13f4f312b145cbb904daebc75026d2/users/65620fcd12544f7094440d60b094cfb1/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:33.931751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26084-dc26-4743-982e-592649a56080 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:33.932060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26084-dc26-4743-982e-592649a56080 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:33.932338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26084-dc26-4743-982e-592649a56080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:33.957824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-79c26084-dc26-4743-982e-592649a56080 None None] MFA Rules not processed for user `5e139fca8faa40a68e582f54917d4237`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:33.959031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-79c26084-dc26-4743-982e-592649a56080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:33.975725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d08103-06eb-49c9-9c80-31276f9833ad None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.020491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 800/1611] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.021509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.021917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79dd34-23aa-477d-a713-039c4713deb9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.022142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.022245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79dd34-23aa-477d-a713-039c4713deb9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.022419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.022532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79dd34-23aa-477d-a713-039c4713deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.022691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.047396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8d79dd34-23aa-477d-a713-039c4713deb9 None None] MFA Rules not processed for user `21f56de0817749b9b85e7ad2b30440ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.048632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8d79dd34-23aa-477d-a713-039c4713deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.082064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.083509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6005fc-fbd3-46e6-a6fe-9ca2136f5f32 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.092978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 812/1612] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:34.094361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50e27-b73d-4499-af72-c064781918ba None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.094653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50e27-b73d-4499-af72-c064781918ba None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.094934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50e27-b73d-4499-af72-c064781918ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.109883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 801/1613] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.110862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57cc2-6ae0-4956-bc9c-7ae30ef71529 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.111150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57cc2-6ae0-4956-bc9c-7ae30ef71529 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.111426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57cc2-6ae0-4956-bc9c-7ae30ef71529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.114939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-20c50e27-b73d-4499-af72-c064781918ba None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.116438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-20c50e27-b73d-4499-af72-c064781918ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.126874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 813/1614] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.127742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c50e27-b73d-4499-af72-c064781918ba None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.137867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c50e27-b73d-4499-af72-c064781918ba None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.142613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.143285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.143568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.143879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.144570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.145478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-28d57cc2-6ae0-4956-bc9c-7ae30ef71529 None None] MFA Rules not processed for user `8cbc1fc5d06c497998053e7eba822643`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.146865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f02b-332f-4ec2-98f1-137e5adfcded admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.146998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-28d57cc2-6ae0-4956-bc9c-7ae30ef71529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.177984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 814/1615] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:34.179518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.179912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.180191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.199085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.200309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.232120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 802/1616] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.233607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2da7-5bea-42ae-878c-6eabb21b8da1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.233900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2da7-5bea-42ae-878c-6eabb21b8da1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.234231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2da7-5bea-42ae-878c-6eabb21b8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.252775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4b5d2da7-5bea-42ae-878c-6eabb21b8da1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.253965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4b5d2da7-5bea-42ae-878c-6eabb21b8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.291320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 815/1617] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.299741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.323520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 803/1618] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.325858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22a29-0548-4f56-b65e-c82c218de694 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.326840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22a29-0548-4f56-b65e-c82c218de694 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.327477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22a29-0548-4f56-b65e-c82c218de694 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.329678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 804/1619] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:34.330508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22a29-0548-4f56-b65e-c82c218de694 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.361252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f1e0-554b-4709-9118-7beebf4dc623 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.364850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.365502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.365780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.366051 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.399361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22a29-0548-4f56-b65e-c82c218de694 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.404275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.405368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.405368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.405368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.416618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.418086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.429245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 805/1620] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:34.429985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.432913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.434576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.443960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569585-0882-49af-957f-cde74a29b8cc service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.444779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 816/1621] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:34.445450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.456913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ca57-d171-4123-938e-6d90a637fb47 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.472622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.472852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.473314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.473596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.473872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.474898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.475272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.475591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.475903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.477446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.479183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.484314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.527035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 817/1622] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:34.529154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.532681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 806/1623] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:34.532681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.541896 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6948-30cd-4dc8-a078-c80a8e2447bc admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.611982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32035435-7ff2-4a07-aba8-7a47166e84fd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.622598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.623511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.623977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.624472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.626982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.627749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.628776 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.629158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.720080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.721835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f8aa-cf61-474f-b2c9-40ba2d89a76e service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.732401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 818/1624] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:34.733817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.734147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.734640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.755276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:34.756544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:34.777390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 819/1625] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:34.778721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.794793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.797567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.826775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 807/1626] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:34.828022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.850254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6e0d-a760-40b4-bccb-c1037d6bd994 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.860148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904a7ff-a1f6-453f-b472-005cd5944358 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.866105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.866954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.867273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.867732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.868483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.869436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.870291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.870728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.871057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.871320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.872247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.874011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.900913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 808/1627] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:34.903152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 820/1628] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:34 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:34.904270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.906614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:34.924671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3db5-d051-4bdf-aa1a-141c4ffc1e91 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.935153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.935438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.935911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.936399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.939577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650014-8be4-4bfa-a594-225ddef9617a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:34.955969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:34.956644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:34.957078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:34.957360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:34.958263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:34.959947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:34.983377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 809/1629] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:34.986581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.014432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f4ec-b904-4d21-8f32-876ec768fd15 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.022023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.023122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.023863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.024036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] PATH_INFO: `/v3/projects/4d70eee6a1d04f86a435874c2ee74a65/users/91dd6102bac54f0c9d22b0d59f4fac5a/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.030438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.032104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.044205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 821/1630] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:35.057469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.060604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d70eee6a1d04f86a435874c2ee74a65, user_id=91dd6102bac54f0c9d22b0d59f4fac5a, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.067301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.080584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41e9b6-f402-4183-b6e2-f7e5d6bbd209 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.095850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 810/1631] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:34 2022] PUT /identity/v3/projects/4d70eee6a1d04f86a435874c2ee74a65/users/91dd6102bac54f0c9d22b0d59f4fac5a/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:35.100457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.217970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.219865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.220363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.220862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] PATH_INFO: `/v3/projects/5655af62f3b14549976caaea122f14d7/users/628d1046dfc146858790da95a8ca917c/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.245544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5655af62f3b14549976caaea122f14d7, user_id=628d1046dfc146858790da95a8ca917c, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.251363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.279854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 822/1632] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:35 2022] PUT /identity/v3/projects/5655af62f3b14549976caaea122f14d7/users/628d1046dfc146858790da95a8ca917c/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:35.281391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.296547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be048af-311f-45d0-9be8-6645a3f9b4c1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.365343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfb92f-afe3-4673-b7b9-7a469adaa88a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.373418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.375536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.378019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.378538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.380550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.387104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b27b5e-ed7f-4695-944a-e71f3da992ca admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.419152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 823/1633] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:35.420535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7d94-e7af-45fb-b33f-f65fbd4068d7 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.420998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7d94-e7af-45fb-b33f-f65fbd4068d7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.421696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7d94-e7af-45fb-b33f-f65fbd4068d7 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.425092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 824/1634] 10.222.0.11 () {54 vars in 912 bytes} [Tue May 3 08:53:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:35.425801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7d94-e7af-45fb-b33f-f65fbd4068d7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.462854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7d94-e7af-45fb-b33f-f65fbd4068d7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.472142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.473952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.474669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.475237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] PATH_INFO: `/v3/projects/5655af62f3b14549976caaea122f14d7/users/628d1046dfc146858790da95a8ca917c/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.477952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5655af62f3b14549976caaea122f14d7, user_id=628d1046dfc146858790da95a8ca917c, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.482265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734722ea-b32a-48ba-a1b7-707de49a09bf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.487138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.487864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.488381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.488685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.489410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.495747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da51a7-9139-4d10-a4bd-76ffb63f45d4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.500293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 825/1635] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:35 2022] PUT /identity/v3/projects/5655af62f3b14549976caaea122f14d7/users/628d1046dfc146858790da95a8ca917c/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:35.502382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.502882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.503331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.526222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:35.528145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:35.531140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 811/1636] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:35.532762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d0f-f442-44c3-85e5-31f4886572d4 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.533049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d0f-f442-44c3-85e5-31f4886572d4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.533328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d0f-f442-44c3-85e5-31f4886572d4 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.534944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 812/1637] 10.222.0.11 () {54 vars in 912 bytes} [Tue May 3 08:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:35.539741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.540072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.540437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.602929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] MFA Rules not processed for user `628d1046dfc146858790da95a8ca917c`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:35.607584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:35.626685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 826/1638] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:35.628254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.707034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6697e-328f-43cc-b37e-933de25aaf01 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.713305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:35.714475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.714819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.715150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] PATH_INFO: `/v3/projects/4d70eee6a1d04f86a435874c2ee74a65/users/91dd6102bac54f0c9d22b0d59f4fac5a/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.717479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d70eee6a1d04f86a435874c2ee74a65, user_id=91dd6102bac54f0c9d22b0d59f4fac5a, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:35.720520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ee1f1-288f-4342-b6d7-659e5b71d9ed admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:35.742992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 827/1639] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:35 2022] PUT /identity/v3/projects/4d70eee6a1d04f86a435874c2ee74a65/users/91dd6102bac54f0c9d22b0d59f4fac5a/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:35.742992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f5394-c9c9-4bf1-89bb-f447cdd31380 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.742992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f5394-c9c9-4bf1-89bb-f447cdd31380 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.742992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f5394-c9c9-4bf1-89bb-f447cdd31380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.758193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-591f5394-c9c9-4bf1-89bb-f447cdd31380 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:35.759634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-591f5394-c9c9-4bf1-89bb-f447cdd31380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:35.822639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 813/1640] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:35.823669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:35.825040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:35.881789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 828/1641] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:35.883500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:35.883895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:35.884082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:35.923710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] MFA Rules not processed for user `91dd6102bac54f0c9d22b0d59f4fac5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:35.924910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6055-604e-49e6-898d-78b9a67e8ee9 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:35.925035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:36.023901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:36.030067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 829/1642] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:36.030067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:36.031325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.032119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.032674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.051603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:36.054327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:36.068095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 814/1643] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:36.069968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:36.123467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404933e-5f75-4ad0-87a0-0100240f0806 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:36.131275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:36.131987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.132318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.132593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.158930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de37bcc-4fdc-4a5c-af3c-b2fcf68593ec service glance] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:36.163048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:36.164314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.164699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.165351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.177287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:36.178951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:36.193600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 815/1644] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:36.217682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:36.219145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:36.231146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 830/1645] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:36.295804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:36.308532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd5581-6a44-42f9-9191-f005b8392c81 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:36.313475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:36.314904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.314904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.314904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.328901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:36.331165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd0c07-74b6-4b83-a837-e7590f1dc813 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:36.358381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 816/1646] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:36.526336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:36.536798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b0c6-675b-40d9-abd8-e5b525a6e808 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:36.550063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:36.551119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.551403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.551678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.665915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:36.669903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f1975-390d-46ba-88bf-664367057654 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:36.684458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 831/1647] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:36.764690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce2cf2-7d0d-44a5-82f1-49bba8c775eb None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.765008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce2cf2-7d0d-44a5-82f1-49bba8c775eb None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.765323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce2cf2-7d0d-44a5-82f1-49bba8c775eb None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.768834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 817/1648] 10.222.0.11 () {54 vars in 912 bytes} [Tue May 3 08:53:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:36.774248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:36.774926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:36.775498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:36.866390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:36.869943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:37.001026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 832/1649] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:37.031626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce2cf2-7d0d-44a5-82f1-49bba8c775eb None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:37.052550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce2cf2-7d0d-44a5-82f1-49bba8c775eb None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:37.058127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:37.059053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:37.059461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:37.059861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:37.077433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:37.080361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427d952-ccea-4a24-8d53-7b3a85bb4276 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:37.104436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 818/1650] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:37.803679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:37.992072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b78c7-c6ed-4150-bfcb-9c83ff88e25d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:38.002314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:38.003223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.003498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.003864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] PATH_INFO: `/v3/users/16f1c2f508d5451fa0cb0eac827fc925` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.008729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f1c2f508d5451fa0cb0eac827fc925)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:38.013285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:38.131902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f1c2f508d5451fa0cb0eac827fc925'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:38.151302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f1c2f508d5451fa0cb0eac827fc925'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:38.166674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f1c2f508d5451fa0cb0eac827fc925'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:38.168012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f1c2f508d5451fa0cb0eac827fc925'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:38.169115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f1c2f508d5451fa0cb0eac827fc925'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:38.212102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 833/1651] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:37 2022] DELETE /identity/v3/users/16f1c2f508d5451fa0cb0eac827fc925 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:38.216965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce473d-ad9a-43d1-a56f-3d63f1d38fa5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.218053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce473d-ad9a-43d1-a56f-3d63f1d38fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.218534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce473d-ad9a-43d1-a56f-3d63f1d38fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.249709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-78ce473d-ad9a-43d1-a56f-3d63f1d38fa5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:38.252010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-78ce473d-ad9a-43d1-a56f-3d63f1d38fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:38.346805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 819/1652] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:53:38.452065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:38.454443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:38.485981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf86da-2f8d-4e10-ba5a-50d8ba2513e7 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.486590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf86da-2f8d-4e10-ba5a-50d8ba2513e7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.487228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf86da-2f8d-4e10-ba5a-50d8ba2513e7 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.489651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 820/1653] 10.222.0.11 () {54 vars in 960 bytes} [Tue May 3 08:53:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:53:38.499591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.500264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.500974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.543714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] MFA Rules not processed for user `020655763b4c4606b1664ad43f047264`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:38.545219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:38.688479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a94537-50a3-4cac-8799-a8bc332ae90f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:38.707475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:38.708765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.708765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.708765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.753549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:38.759466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:38.818065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 834/1654] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:38.823807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 821/1655] 10.222.0.11 () {58 vars in 1057 bytes} [Tue May 3 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:53:38.833113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:38.883741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4802a-628d-4a04-bba5-f7e5e910fa99 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:38.914429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:38.920902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:38.924928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:38.925254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:38.939616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:38.984871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:38.986503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:39.032602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 835/1656] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:40.268919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:40.271168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:40.291749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65798f5-9f17-4c55-8a55-af8a2969376b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:40.300010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:40.301871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:40.302428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:40.302927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] PATH_INFO: `/v3/projects/dd3c900a5a11493aa63f6ed8299ecbc1` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:40.304468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3c900a5a11493aa63f6ed8299ecbc1)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:40.307361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:40.392137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3c900a5a11493aa63f6ed8299ecbc1', 'request_id': 'req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.408932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3c900a5a11493aa63f6ed8299ecbc1', 'request_id': 'req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.420364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3c900a5a11493aa63f6ed8299ecbc1', 'request_id': 'req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.446558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] The token cache is being invalidate because project dd3c900a5a11493aa63f6ed8299ecbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:53:40.447185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.450843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.454987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 822/1657] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:40 2022] DELETE /identity/v3/projects/dd3c900a5a11493aa63f6ed8299ecbc1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:40.459400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:40.519548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c24f-e440-4efb-aae9-e679414c35ab service placement] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:40.640954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:40.642034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:40.642452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:40.642888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] PATH_INFO: `/v3/users/91dd6102bac54f0c9d22b0d59f4fac5a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:40.648548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91dd6102bac54f0c9d22b0d59f4fac5a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:40.650801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:40.817772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91dd6102bac54f0c9d22b0d59f4fac5a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.833992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91dd6102bac54f0c9d22b0d59f4fac5a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.844680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91dd6102bac54f0c9d22b0d59f4fac5a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.845442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91dd6102bac54f0c9d22b0d59f4fac5a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.846064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4c06783c-980a-4e7e-81e7-32e6478f3128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91dd6102bac54f0c9d22b0d59f4fac5a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:40.905791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 836/1658] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:40 2022] DELETE /identity/v3/users/91dd6102bac54f0c9d22b0d59f4fac5a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:41.984495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:41.986554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:42.009335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9147b-1c16-4b4a-b1a5-549fde7db70b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:42.137814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:42.139490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.140118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.140539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] PATH_INFO: `/v3/projects/4d70eee6a1d04f86a435874c2ee74a65` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.143624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d70eee6a1d04f86a435874c2ee74a65)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:42.145933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:42.259930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d70eee6a1d04f86a435874c2ee74a65', 'request_id': 'req-cc4d005b-576f-44aa-9154-823a08a145f6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:42.277188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d70eee6a1d04f86a435874c2ee74a65', 'request_id': 'req-cc4d005b-576f-44aa-9154-823a08a145f6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:42.297379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d70eee6a1d04f86a435874c2ee74a65', 'request_id': 'req-cc4d005b-576f-44aa-9154-823a08a145f6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:42.329584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] The token cache is being invalidate because project 4d70eee6a1d04f86a435874c2ee74a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:53:42.329902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:42.331667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cc4d005b-576f-44aa-9154-823a08a145f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:42.335729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 823/1659] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:41 2022] DELETE /identity/v3/projects/4d70eee6a1d04f86a435874c2ee74a65 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:42.341516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.342163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.342163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.385937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:42.387178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:42.575672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 837/1660] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:42.577046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.577340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.577841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.630188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:42.631439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:42.676032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 824/1661] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:42.683396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:42.700950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc61962-316d-4eb8-bed0-0e26af241340 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:42.729813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:42.732897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.733089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.734039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.735304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:42.740397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:42.748701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eb19e-a2a4-415c-8bc1-830318c418f1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:42.794237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 838/1662] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:42.798139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:42.808689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ffefa-8b23-4110-b224-7380aecae8d6 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:42.820400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.820675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.820954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.837862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:42.843340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:42.850800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:42.851228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:42.852594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:42.856797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:42.861921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] MFA Rules not processed for user `027eeadca01b4c4f93b892ef0fbcb195`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:42.863934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:42.941302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 825/1663] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:42 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:42.949948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.030972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 839/1664] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:43.035665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.041662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:43.110356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd620-3212-415d-b993-d32cf0f04dd0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.132509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.133201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.133479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.133749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.134514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.136484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.191985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 826/1665] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:42 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:43.192857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18e09e-c893-4fbd-a282-f9ce73fc8f23 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.195301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.215979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e32d-6d0d-4ea6-a49a-c7e95f99b485 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.222336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.223527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.223996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.224404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.225367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.227357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.241107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 827/1666] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:43.245249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.258728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc54ce-e697-4fd1-8b0f-bc45aabaa529 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.268035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.269295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.270052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.270473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.271458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.273598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.291740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 828/1667] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:53:43.307029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.314120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.314814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.315102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.315522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.334245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f7f5b-47c9-4186-b887-b7e90e79ddb2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.346592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.347553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.347861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.348131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] PATH_INFO: `/v3/projects/14326fa1af0d4a25b58b551299f968bf/users/4af818e6df2041039c56c0f472967dc3/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.389209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14326fa1af0d4a25b58b551299f968bf, user_id=4af818e6df2041039c56c0f472967dc3, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.395587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36860d13-73ac-484f-887d-2a1441449d09 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.417380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 829/1668] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:43 2022] PUT /identity/v3/projects/14326fa1af0d4a25b58b551299f968bf/users/4af818e6df2041039c56c0f472967dc3/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:43.421855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.424788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.428833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.429399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.429864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.438530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 840/1669] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:43.464544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] MFA Rules not processed for user `4af818e6df2041039c56c0f472967dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:43.465766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:43.557740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.565457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 830/1670] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:53:43.572558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3384f-ad2c-4459-a09c-c9788276f9d5 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.668320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.669008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.669291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.669579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.670264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.676800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.736117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 841/1671] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:43 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:43.742280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.758794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8227a79-f958-49ad-aa14-3604d46173fa None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.885522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.886286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.886607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.886761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.887732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.896170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.932396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 831/1672] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:43 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:43.933533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:43.948330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5c42-8aaa-4c1c-b7b5-1d439378c80c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:43.964973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:43.967424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:43.967929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:43.968394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:43.969766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:43.972021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:43.990116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 842/1673] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:43.991125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:44.004969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779fe9d-05f4-479f-83bf-35f028f789bb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:44.013023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:44.014207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:44.015232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:44.015909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] PATH_INFO: `/v3/projects/826fbe2cb97744e382add55be587e98e/users/92b33f788e7d4a2c9150309ae6913362/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:44.058872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826fbe2cb97744e382add55be587e98e, user_id=92b33f788e7d4a2c9150309ae6913362, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:44.062648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:44.098518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 832/1674] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:43 2022] PUT /identity/v3/projects/826fbe2cb97744e382add55be587e98e/users/92b33f788e7d4a2c9150309ae6913362/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:53:44.105744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:44.121138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c12f64-ef94-45b8-a212-7cb76ccec632 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:44.214984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:44.215669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:44.216102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:44.216373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:44.217099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:44.218709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7951e-eaeb-4cfc-905f-d07fac9c5c1c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:44.243973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 843/1675] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:44.244184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:44.269704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea2db6-8882-419a-a590-79d32ccb55b8 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:44.284657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:44.285629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:44.285914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:44.286190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] PATH_INFO: `/v3/projects/826fbe2cb97744e382add55be587e98e/users/92b33f788e7d4a2c9150309ae6913362/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:44.290148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] RBAC: Authorizing `identity:create_grant(project_id=826fbe2cb97744e382add55be587e98e, user_id=92b33f788e7d4a2c9150309ae6913362, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:44.292897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:44.323545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 833/1676] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:44 2022] PUT /identity/v3/projects/826fbe2cb97744e382add55be587e98e/users/92b33f788e7d4a2c9150309ae6913362/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:44.340032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64838-933c-4cda-9a5b-b7813e5c5406 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:44.340480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64838-933c-4cda-9a5b-b7813e5c5406 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:44.340775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64838-933c-4cda-9a5b-b7813e5c5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:44.412137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1fa64838-933c-4cda-9a5b-b7813e5c5406 None None] MFA Rules not processed for user `92b33f788e7d4a2c9150309ae6913362`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:44.413391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1fa64838-933c-4cda-9a5b-b7813e5c5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:44.611819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 844/1677] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:44.621101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:44.624015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:44.889903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78433c-6dee-4fb3-9afb-dc83272b276a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:44.916592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:44.927796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:44.928395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:44.931652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:44.965334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:44.966795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99178c8a-6d38-4aa1-96b5-c82985c8f49f service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:44.992096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 834/1678] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:46.642510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:46.643383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:46.644152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:46.692143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] MFA Rules not processed for user `027eeadca01b4c4f93b892ef0fbcb195`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:46.693440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:46.849004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 845/1679] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:46.916811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:46.917318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:46.917397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:46.959652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:46.962031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:47.205412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 835/1680] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:53:47.525038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:47.525732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:47.689167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b2db-13e0-43f8-803d-2c6e6e9c36cb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:47.703253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:47.703963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:47.704253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:47.704528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:47.737774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:47.740155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:47.781834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 846/1681] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 08:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:53:48.593099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:48.787754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db05f-e223-420d-a7ce-49c5bcb14b87 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:48.796536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:48.797758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:48.798209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:48.798677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] PATH_INFO: `/v3/users/4af818e6df2041039c56c0f472967dc3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:48.804626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af818e6df2041039c56c0f472967dc3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:48.806394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: WARNING py.warnings [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:48.806394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: warnings.warn(msg) May 03 08:53:48.806394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: May 03 08:53:48.809844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:48.842115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:48.843748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:48.882694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca533cb-3f0a-4f32-9074-e491f9427de4 service swift] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:48.898357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:48.900177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:48.902587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:48.903088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] PATH_INFO: `/v3/users/21f56de0817749b9b85e7ad2b30440ba` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:48.908430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f56de0817749b9b85e7ad2b30440ba)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:48.914669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:49.007306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af818e6df2041039c56c0f472967dc3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.009279 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af818e6df2041039c56c0f472967dc3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.009918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af818e6df2041039c56c0f472967dc3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.045590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f56de0817749b9b85e7ad2b30440ba'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.063831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f56de0817749b9b85e7ad2b30440ba'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.086783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f56de0817749b9b85e7ad2b30440ba'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.088209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f56de0817749b9b85e7ad2b30440ba'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.089573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-53a6e415-571e-41fe-9ebc-bc58cf0294bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f56de0817749b9b85e7ad2b30440ba'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.096062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af818e6df2041039c56c0f472967dc3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.135394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-560c8a5d-7618-4356-ab58-6ae6e1fbc998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af818e6df2041039c56c0f472967dc3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:49.156339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 847/1682] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:48 2022] DELETE /identity/v3/users/21f56de0817749b9b85e7ad2b30440ba => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:53:49.161668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:49.162174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:49.162665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:49.193960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 836/1683] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:48 2022] DELETE /identity/v3/users/4af818e6df2041039c56c0f472967dc3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:49.202099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:49.203143 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:49.205219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:49.206782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:49.209683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:49.263394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:49.272720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:49.333262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 848/1684] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:49.343461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:49.345658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:49.427642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedff3-b5f6-459e-bf0a-18b545558fa2 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:49.431085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 837/1685] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:49.439412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:49.440117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:49.440682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:49.441060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:49.441748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:49.454129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:49.456549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:49.456936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d4917-a82e-4382-8f87-db3dd502c196 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:49.467898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:49.468733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:49.469114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:49.469489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:49.470661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 849/1686] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:53:49.482964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:49.485405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:49.501345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 838/1687] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:53:50.307259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:50.309623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:50.347917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43acc1-f02c-467d-af83-73e16029ee31 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:50.365948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:50.372387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:50.372741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:50.373083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] PATH_INFO: `/v3/projects/14326fa1af0d4a25b58b551299f968bf` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:50.379656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14326fa1af0d4a25b58b551299f968bf)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:50.380853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: WARNING py.warnings [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 08:53:50.380853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: warnings.warn(msg) May 03 08:53:50.380853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: May 03 08:53:50.389385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:50.556167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:50.558331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:50.631309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877a50-819c-4399-a1a4-219031fe72be service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:50.717391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14326fa1af0d4a25b58b551299f968bf', 'request_id': 'req-1797e059-97ce-4fa5-9668-bbdb4c43e488'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:50.727436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14326fa1af0d4a25b58b551299f968bf', 'request_id': 'req-1797e059-97ce-4fa5-9668-bbdb4c43e488'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:50.740017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14326fa1af0d4a25b58b551299f968bf', 'request_id': 'req-1797e059-97ce-4fa5-9668-bbdb4c43e488'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:50.792203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] The token cache is being invalidate because project 14326fa1af0d4a25b58b551299f968bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:53:50.792507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:50.795239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:50.801217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 850/1688] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:50 2022] DELETE /identity/v3/projects/14326fa1af0d4a25b58b551299f968bf => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:50.805848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:50.807983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:50.943747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:50.951518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:50.952176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:50.952569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] PATH_INFO: `/v3/projects/e1b96785b6d3430093edf139cb1e7947` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:50.956145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b96785b6d3430093edf139cb1e7947)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:50.965519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:51.075916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e059-97ce-4fa5-9668-bbdb4c43e488 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:51.102033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:51.102982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:51.103270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:51.103545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] PATH_INFO: `/v3/users/92b33f788e7d4a2c9150309ae6913362` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:51.113099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b33f788e7d4a2c9150309ae6913362)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:51.115090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:51.212863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b96785b6d3430093edf139cb1e7947', 'request_id': 'req-12f59c46-d874-4066-8d6d-e323b419880f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.244204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b96785b6d3430093edf139cb1e7947', 'request_id': 'req-12f59c46-d874-4066-8d6d-e323b419880f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.263059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b96785b6d3430093edf139cb1e7947', 'request_id': 'req-12f59c46-d874-4066-8d6d-e323b419880f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.302624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] The token cache is being invalidate because project e1b96785b6d3430093edf139cb1e7947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:53:51.305817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.312480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-12f59c46-d874-4066-8d6d-e323b419880f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.315865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 839/1689] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:50 2022] DELETE /identity/v3/projects/e1b96785b6d3430093edf139cb1e7947 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:51.320622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26a64-cc0d-49db-94d7-b11ffe29602e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:51.321405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26a64-cc0d-49db-94d7-b11ffe29602e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:51.323891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26a64-cc0d-49db-94d7-b11ffe29602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:51.364479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b33f788e7d4a2c9150309ae6913362'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.395625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b33f788e7d4a2c9150309ae6913362'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.409115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-aec26a64-cc0d-49db-94d7-b11ffe29602e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:51.414257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b33f788e7d4a2c9150309ae6913362'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.416101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-aec26a64-cc0d-49db-94d7-b11ffe29602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:51.417067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b33f788e7d4a2c9150309ae6913362'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.423302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3629a7d5-e46e-4000-818f-ad01abf9d9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b33f788e7d4a2c9150309ae6913362'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:51.471524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 851/1690] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:50 2022] DELETE /identity/v3/users/92b33f788e7d4a2c9150309ae6913362 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:51.494424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875cdca-fcdc-43ef-9471-7e747aeff41e None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:51.494918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875cdca-fcdc-43ef-9471-7e747aeff41e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:51.495454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875cdca-fcdc-43ef-9471-7e747aeff41e None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:51.497243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 852/1691] 10.222.0.11 () {54 vars in 912 bytes} [Tue May 3 08:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:53:51.511653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:51.512144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:51.512491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:51.549459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:51.552837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:51.737997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 840/1692] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:51.747060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:51.751254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:51.751695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:51.863647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:51.871740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:51.877345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 853/1693] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:52.072417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.074835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:52.114395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3944b40-36a1-4a30-bf82-027d36940700 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.131743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.145916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 841/1694] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:52.146120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.146120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.146120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.147684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.168795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9046e-a40f-4491-803f-d825b23d9f39 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.172852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.186333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.219483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.222924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.225057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.225930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.229958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:52.232024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.237946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.254993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 854/1695] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:53:52.344034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 842/1696] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:52.348087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.392970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1ac02-7696-4280-b71d-9562a7c9c317 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.420056 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.421142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.421595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.421975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.424845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.433431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.465879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.468630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:52.509907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 855/1697] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:52 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:53:52.513767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.524807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f45ac-ba81-47b5-bc77-5028236dd4b1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.628923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2dc4-4c79-45ba-89ef-357fc674da16 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.634973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.636194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.636858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.637344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.638539 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.641178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.696586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 856/1698] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:52 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:53:52.699831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.725928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39ff4-bbd1-41a8-ab25-a0a7b0a3ccda admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.734803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.735874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.736176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.736456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.737199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.738966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.751175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 857/1699] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:52.755286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.758349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.759316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.759644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.759956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] PATH_INFO: `/v3/projects/826fbe2cb97744e382add55be587e98e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.761196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] RBAC: Authorizing `identity:delete_project(project_id=826fbe2cb97744e382add55be587e98e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.763450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.775004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252fde6-6715-4f2e-97ab-642089960e5a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.810622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:52.812276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:52.812688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:52.813182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:52.815673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:52.819735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:52.861215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826fbe2cb97744e382add55be587e98e', 'request_id': 'req-c8d3aadb-aa82-466f-865d-1edf19b3141e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:52.881662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 858/1700] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:53:52.886100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:52.889637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826fbe2cb97744e382add55be587e98e', 'request_id': 'req-c8d3aadb-aa82-466f-865d-1edf19b3141e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:52.939600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826fbe2cb97744e382add55be587e98e', 'request_id': 'req-c8d3aadb-aa82-466f-865d-1edf19b3141e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:52.961768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1583e-86dd-4e47-a66c-f702177fe993 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:52.975232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] The token cache is being invalidate because project 826fbe2cb97744e382add55be587e98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:53:52.978333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:52.980943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8d3aadb-aa82-466f-865d-1edf19b3141e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:52.992031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 843/1701] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:52 2022] DELETE /identity/v3/projects/826fbe2cb97744e382add55be587e98e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:53.000967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9388-e388-40d9-aa5a-1079940cfc26 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.001842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9388-e388-40d9-aa5a-1079940cfc26 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.002670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9388-e388-40d9-aa5a-1079940cfc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.048445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c57e9388-e388-40d9-aa5a-1079940cfc26 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:53.051454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c57e9388-e388-40d9-aa5a-1079940cfc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:53.125824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.126895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.131561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.132219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] PATH_INFO: `/v3/projects/3cf350d6bf09489a8c347e49132a0015/users/caf074c5383c4473bba09aebd29f9f4f/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.197029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf350d6bf09489a8c347e49132a0015, user_id=caf074c5383c4473bba09aebd29f9f4f, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.197029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0911-23bb-4380-9cd1-c4fb851976a0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.220168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 844/1702] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:53.233537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.235606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.236309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.266504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:53.266504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:53.267408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 859/1703] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:52 2022] PUT /identity/v3/projects/3cf350d6bf09489a8c347e49132a0015/users/caf074c5383c4473bba09aebd29f9f4f/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:53.275204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.275820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.276321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.341940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:53.344585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:53.351635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 845/1704] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:53.362260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.369011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 860/1705] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:53.379483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.385152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:53.388668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533474-4112-4cfb-b5f8-54b9f820bc06 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:53.396575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.397679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.398150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.398639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.399954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:53.400409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.402631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.452283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 846/1706] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:53.455971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.491059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900967d3-8fd4-41fc-a861-b09619eaa402 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:53.515473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.523022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.523871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816745d-3f71-4da6-9da8-62c9f53d81af None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:53.524783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.525533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.528853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.533627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.538320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.539881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.541689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.542952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.581742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.587453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.594839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 847/1707] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:53 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:53.599095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.623912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 861/1708] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:53.776657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea0fd0-9c38-4fa1-af2a-1dc4dc6793ca admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:53.792068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.798149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.798149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.799849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.804153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.810154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.868591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 848/1709] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:53 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:53:53.870326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.888137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e527-08ca-4baa-80b6-a81a104d82f4 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:53.916666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:53.917570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:53.917929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:53.918308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:53.919149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:53.920949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:53.952691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 862/1710] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:53.954197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:53.979276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc91b2-bad5-4de4-9dd2-3f411bebcf47 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:54.008839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:54.009707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.010181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.010603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.011527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:54.013487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864062b-2046-467f-ae10-c8c9ad698efa admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:54.035994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 849/1711] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:54.039584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:54.054394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250bc0-f519-4093-b853-546e2e9b7367 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:54.080988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:54.084093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.088802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.090193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] PATH_INFO: `/v3/projects/19a439e68ea94098a5faa727f442656c/users/a88120f17193416c8cfea7ad0400b364/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.137009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a439e68ea94098a5faa727f442656c, user_id=a88120f17193416c8cfea7ad0400b364, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:54.144607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:54.173223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 863/1712] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:54 2022] PUT /identity/v3/projects/19a439e68ea94098a5faa727f442656c/users/a88120f17193416c8cfea7ad0400b364/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:54.184449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.185299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.185299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.231022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] MFA Rules not processed for user `a88120f17193416c8cfea7ad0400b364`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:54.235989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:54.377315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 850/1713] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:54.378657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:54.479446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f76ed-7f39-4262-a0ba-c974ac282e56 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:54.485928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:54.486866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.487324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.487754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.488655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:54.490979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:54.540338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 864/1714] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:54 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:54.541349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:54.580986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c24359-cae6-4004-b1d4-70cde9477a78 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:54.867547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:54.868310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.868636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.869042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.869951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:54.873015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41221954-6b48-4958-bd53-62c56f84cd9f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:54.912717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 851/1715] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:54 2022] POST /identity/v3/users => generated 297 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:54.916994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:54.938699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f59f-c495-4fe6-8e88-c26432a15eef admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:54.951119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:54.955108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.955467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.958866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:54.959882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:54.963727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:54.972422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805187-d8ee-4215-97b0-808430401989 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:54.972712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805187-d8ee-4215-97b0-808430401989 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:54.973146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805187-d8ee-4215-97b0-808430401989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.010873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 865/1716] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:55.011840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:55.042869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda05e7-e267-43a6-946f-130a7760f8ae admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:55.054837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:55.058623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:55.058951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:55.060266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] PATH_INFO: `/v3/projects/3742a9df0c124138965b8c325a54f675/users/e9b85f39a7ec4690ab231dccfc6be7d3/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.089086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-54805187-d8ee-4215-97b0-808430401989 None None] MFA Rules not processed for user `e6d1a1b1c3754f0d856df4ca7a8e0269`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:55.090329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-54805187-d8ee-4215-97b0-808430401989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:55.093039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3742a9df0c124138965b8c325a54f675, user_id=e9b85f39a7ec4690ab231dccfc6be7d3, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:55.097569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:55.119538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 866/1717] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:55 2022] PUT /identity/v3/projects/3742a9df0c124138965b8c325a54f675/users/e9b85f39a7ec4690ab231dccfc6be7d3/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:55.123627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:55.243548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4cc98-a5df-4d9b-a85c-cb891ec6ebeb admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:55.265249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:55.266758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:55.267206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:55.267824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.269090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:55.277208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:55.352748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 867/1718] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:53:55.359572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:55.364774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:55.421906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e1d6-6808-48ee-a424-beff03c8fc06 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:55.442784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:55.444785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:55.444785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:55.444785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] PATH_INFO: `/v3/users/5e139fca8faa40a68e582f54917d4237` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.449845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e139fca8faa40a68e582f54917d4237)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:55.460490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:55.587966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 852/1719] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:55.590778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:55.591085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:55.591480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.605650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e139fca8faa40a68e582f54917d4237'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:55.622381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e139fca8faa40a68e582f54917d4237'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:55.645837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e139fca8faa40a68e582f54917d4237'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:55.647226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e139fca8faa40a68e582f54917d4237'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:55.650584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e96c9055-d085-4ff7-96b2-3571149bc995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e139fca8faa40a68e582f54917d4237'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:53:55.695424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:55.705215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:55.720357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 868/1720] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:53:55 2022] DELETE /identity/v3/users/5e139fca8faa40a68e582f54917d4237 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:55.721193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c34c6-f0c6-464a-97c1-fa03799be207 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:55.721673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c34c6-f0c6-464a-97c1-fa03799be207 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:55.721914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c34c6-f0c6-464a-97c1-fa03799be207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:55.815393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-167c34c6-f0c6-464a-97c1-fa03799be207 None None] MFA Rules not processed for user `65620fcd12544f7094440d60b094cfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:55.826487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-167c34c6-f0c6-464a-97c1-fa03799be207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:55.935491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 853/1721] 10.222.0.21 () {58 vars in 1015 bytes} [Tue May 3 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:55.936616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:55.943190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.049697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628065c-9905-4ea1-b70a-03a69532b49f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:56.071786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:56.085542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.086977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.087387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] PATH_INFO: `/v3/projects/3742a9df0c124138965b8c325a54f675/users/e9b85f39a7ec4690ab231dccfc6be7d3/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.090739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3742a9df0c124138965b8c325a54f675, user_id=e9b85f39a7ec4690ab231dccfc6be7d3, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:56.096746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6725-b909-4a60-a27f-50be6c85b32d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:56.123105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 854/1722] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:55 2022] PUT /identity/v3/projects/3742a9df0c124138965b8c325a54f675/users/e9b85f39a7ec4690ab231dccfc6be7d3/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:56.123338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 869/1723] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:56.123425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc858-4bee-4623-8fb0-043b4f4a263d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.123425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc858-4bee-4623-8fb0-043b4f4a263d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.123425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc858-4bee-4623-8fb0-043b4f4a263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.123612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.123612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.123612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.164494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] MFA Rules not processed for user `caf074c5383c4473bba09aebd29f9f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:56.166676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.174687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e2dcc858-4bee-4623-8fb0-043b4f4a263d None None] MFA Rules not processed for user `e6d1a1b1c3754f0d856df4ca7a8e0269`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:56.176509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e2dcc858-4bee-4623-8fb0-043b4f4a263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.299472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 855/1724] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:56.303028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dbcb0-40cb-47a8-b147-c8f86ecc8de4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.303610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dbcb0-40cb-47a8-b147-c8f86ecc8de4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.304112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dbcb0-40cb-47a8-b147-c8f86ecc8de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.346548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 870/1725] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:56.347488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:56.349513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.357549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-434dbcb0-40cb-47a8-b147-c8f86ecc8de4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:56.358870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-434dbcb0-40cb-47a8-b147-c8f86ecc8de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.541061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 856/1726] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:56.545028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2452d-3094-4956-9807-76eb92725647 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.546933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2452d-3094-4956-9807-76eb92725647 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.547805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2452d-3094-4956-9807-76eb92725647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.570828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735432-5e7a-4492-9640-438bac8f2664 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:56.589082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:56.589760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.590120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.590321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.604556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:56.611356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:56.637505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-84f2452d-3094-4956-9807-76eb92725647 None None] MFA Rules not processed for user `e9b85f39a7ec4690ab231dccfc6be7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:53:56.640167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-84f2452d-3094-4956-9807-76eb92725647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.640453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 871/1727] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:56.642024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:56.654791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.826087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 857/1728] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:53:56.827261 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2452d-3094-4956-9807-76eb92725647 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:56.830105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-84f2452d-3094-4956-9807-76eb92725647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:56.868139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2452d-3094-4956-9807-76eb92725647 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:56.872788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbfc4-6a9e-40d3-a336-10ed094fec67 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:56.879636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:56.880354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.880638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.880908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.881603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:56.885151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:56.890337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:56.890998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:56.891374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:56.891541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:56.977701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 858/1729] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:56 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:56.992582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:57.000262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:57.128753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:57.136508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:57.173514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 872/1730] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:57.188784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:57.197101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:57.289509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e542d-624a-4b8e-8d72-938e4390dbba admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:57.310202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72a92-f98a-4bf3-9490-f43997c265f7 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:57.312371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:57.317854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:57.318159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:57.318445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:57.599224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:57.602365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:57.610095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:57.611356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:57.612259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:57.613698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:57.617333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:57.646760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 859/1731] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:57.650075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:57.652619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:57.844435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3a700-bd33-44f1-b5d9-d879d901cdf4 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:57.864200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:57.864893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:57.866328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:57.866574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:57.868124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:57.874058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:57.913122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 873/1732] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:57.913877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:57.961454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284575d-2a04-4f9c-908b-399abe0918ec service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:57.986517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:57.987205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:57.987568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:57.987798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:57.988475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:57.990935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.114108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 874/1733] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:53:57 2022] POST /identity/v3/users => generated 309 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:58.115919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:58.132480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:58.134846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.153375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016e7c-3656-4647-957d-9c1107858619 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:58.173447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:58.175690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:58.176004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:58.176279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:58.178414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 860/1734] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:53:58.179285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:58.188247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.221168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 875/1735] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:58.222408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:58.237040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2c85-e602-4a20-be6a-0b5c7a4d1035 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:58.264854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:58.271400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:58.271400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:58.271400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] PATH_INFO: `/v3/projects/2928f9a9001b49ea99a85be5ca592c5e/users/57c05c5ffe63471db0f0f9e87df9370e/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:58.352957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2928f9a9001b49ea99a85be5ca592c5e, user_id=57c05c5ffe63471db0f0f9e87df9370e, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:58.362213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.416422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 861/1736] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:58 2022] PUT /identity/v3/projects/2928f9a9001b49ea99a85be5ca592c5e/users/57c05c5ffe63471db0f0f9e87df9370e/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:58.420274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:58.434811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812574-38ba-4439-8c1a-ec34b7a8e90b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:58.792758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:58.793409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:58.793756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:58.794037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:58.795216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:58.796720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.861802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 876/1737] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:53:58.866572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:58.894193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99363a9-60ee-4f98-814f-a534fdde4b31 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:58.906975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:58.908071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:58.908353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:58.908894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] PATH_INFO: `/v3/projects/2928f9a9001b49ea99a85be5ca592c5e/users/57c05c5ffe63471db0f0f9e87df9370e/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:58.914579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2928f9a9001b49ea99a85be5ca592c5e, user_id=57c05c5ffe63471db0f0f9e87df9370e, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:58.916643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:58.925068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:58.968893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 862/1738] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:53:58 2022] PUT /identity/v3/projects/2928f9a9001b49ea99a85be5ca592c5e/users/57c05c5ffe63471db0f0f9e87df9370e/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:53:59.075452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8476da-ed34-45cb-b174-745d65f58f01 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:59.325576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b85f39a7ec4690ab231dccfc6be7d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3742a9df0c124138965b8c325a54f675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:59.328015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:59.328298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:59.328579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:59.330514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:59.335498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:59.336851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:59.381660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:59.382656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 877/1739] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:59.399777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b32361-a753-4fbc-aa6f-f2bd10c17d3c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:59.423651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b85f39a7ec4690ab231dccfc6be7d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3742a9df0c124138965b8c325a54f675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:59.434388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:59.435411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:59.435699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:59.436870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:59.438886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:59.527549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 863/1740] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:53:59 2022] POST /identity/v3/projects => generated 354 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:53:59.528889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:59.552615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f9e1-6768-4336-9be0-8e325f6539e4 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:53:59.824226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b85f39a7ec4690ab231dccfc6be7d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3742a9df0c124138965b8c325a54f675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:53:59.824942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:53:59.825323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:53:59.825672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:53:59.826718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:53:59.827167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:53:59.829132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:53:59.859712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 878/1741] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:53:59.861149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:59.862840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:53:59.971340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:53:59.991335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b9646-fcf2-4e70-902a-1cc389ee3070 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:00.004745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b85f39a7ec4690ab231dccfc6be7d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3742a9df0c124138965b8c325a54f675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:00.005650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.005937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.006207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] PATH_INFO: `/v3/projects/3f9c25221701460eb74a67795de20f8a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.019640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f9c25221701460eb74a67795de20f8a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:00.021946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:00.038003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1722-5987-495d-97d1-ee27594cfbc1 tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:00.048271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:00.049618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.050048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.050497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] PATH_INFO: `/v3/projects/898b965c33d64abcb120ca3f3d0b0478` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.053551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898b965c33d64abcb120ca3f3d0b0478)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:00.059120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:00.135634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9c25221701460eb74a67795de20f8a', 'request_id': 'req-1754e722-75b0-487f-be58-4bef714939ce'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.152230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9c25221701460eb74a67795de20f8a', 'request_id': 'req-1754e722-75b0-487f-be58-4bef714939ce'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.189326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9c25221701460eb74a67795de20f8a', 'request_id': 'req-1754e722-75b0-487f-be58-4bef714939ce'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.212937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898b965c33d64abcb120ca3f3d0b0478', 'request_id': 'req-5e53a442-867e-4aab-b249-04122e32bf80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.237310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898b965c33d64abcb120ca3f3d0b0478', 'request_id': 'req-5e53a442-867e-4aab-b249-04122e32bf80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.263808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] The token cache is being invalidate because project 3f9c25221701460eb74a67795de20f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:00.266814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.273264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1754e722-75b0-487f-be58-4bef714939ce tempest-VolumeQuotaClassesTest-2017009130 tempest-VolumeQuotaClassesTest-2017009130-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.279732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 879/1742] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:59 2022] DELETE /identity/v3/projects/3f9c25221701460eb74a67795de20f8a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:00.295994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898b965c33d64abcb120ca3f3d0b0478', 'request_id': 'req-5e53a442-867e-4aab-b249-04122e32bf80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.352441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] The token cache is being invalidate because project 898b965c33d64abcb120ca3f3d0b0478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:00.352791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.364347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5e53a442-867e-4aab-b249-04122e32bf80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:00.385188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 864/1743] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:53:59 2022] DELETE /identity/v3/projects/898b965c33d64abcb120ca3f3d0b0478 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:00.390343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.390839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.391250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.452159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:00.453226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:00.513378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3d17-0c77-48db-99ac-3f0a0d37ad04 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.513782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3d17-0c77-48db-99ac-3f0a0d37ad04 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.514215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3d17-0c77-48db-99ac-3f0a0d37ad04 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.516599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 865/1744] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:54:00.697707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 880/1745] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:00.706238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.706867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.707393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.764865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:00.768952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:00.797064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 866/1746] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:00.798277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:00.810171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9ecd9-df04-4e21-a850-d548433db06e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:00.825326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:00.826183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.826373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.826638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.827361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:00.827670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:00.829309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:00.846095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:00.847528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:00.870824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187048-4da9-4732-a650-812aeef26e7d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:00.883903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 881/1747] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:00.888396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:00.895590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:00.896717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.897131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.897508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] PATH_INFO: `/v3/users/a88120f17193416c8cfea7ad0400b364` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.899543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88120f17193416c8cfea7ad0400b364)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:00.902256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:00.905418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e13a41-0aae-4f07-849c-82dcca0e1228 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:00.920614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:00.921307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:00.921585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:00.921870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:00.922548 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:00.924876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:00.983172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 882/1748] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:00 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:00.984319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:01.009477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88120f17193416c8cfea7ad0400b364'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:01.010504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88120f17193416c8cfea7ad0400b364'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:01.011514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88120f17193416c8cfea7ad0400b364'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:01.042937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88120f17193416c8cfea7ad0400b364'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:01.059013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-40b48f43-c528-4784-85eb-db55cafd6f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88120f17193416c8cfea7ad0400b364'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:01.090222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 867/1749] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:00 2022] DELETE /identity/v3/users/a88120f17193416c8cfea7ad0400b364 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:01.098202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243a0c-2f14-4d49-9c26-2cf188431289 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.098527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243a0c-2f14-4d49-9c26-2cf188431289 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.099526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243a0c-2f14-4d49-9c26-2cf188431289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.172618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36821d5-25a3-49a7-8c16-d42ab9a674ed admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:01.175129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-97243a0c-2f14-4d49-9c26-2cf188431289 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:01.177221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-97243a0c-2f14-4d49-9c26-2cf188431289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:01.319610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:01.321537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.321811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.322079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.322772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:01.324746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:01.354732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 868/1750] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:01.359173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.359459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.359863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.375237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 883/1751] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:00 2022] POST /identity/v3/users => generated 288 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:01.385276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:01.387993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:01.435816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:01.435816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:01.449275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2246-e2cf-476e-a112-003f83998a86 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:01.459463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:01.460111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.460392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.460695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.462908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:01.465164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:01.472502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 869/1752] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:01.486729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:01.488172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:01.493310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 884/1753] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:01.496927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:01.532940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772492-f503-4951-8e57-1748eb8e41d3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:01.551121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:01.553162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.553454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.553725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.554541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:01.563691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:01.585008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 885/1754] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:01.589216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:01.617253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7f22-fcb1-4e6f-a55f-b854854f8305 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:01.647345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:01.648860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.653475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.655425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] PATH_INFO: `/v3/projects/1fec36045ac348f4a44223605f9bdb13/users/059579e95d6648b1bcf77ae9d484cbbc/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.663239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba916-5b3d-4c04-9afa-6e54efd3fe96 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:01.680265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:01.682602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.684606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.686430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.720861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fec36045ac348f4a44223605f9bdb13, user_id=059579e95d6648b1bcf77ae9d484cbbc, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:01.736443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:01.737603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2d858-ee0f-4c66-b3db-7754a0437e4c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:01.740290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:01.787234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 886/1755] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:01 2022] PUT /identity/v3/projects/1fec36045ac348f4a44223605f9bdb13/users/059579e95d6648b1bcf77ae9d484cbbc/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:01.798684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:01.800068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 870/1756] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:01.803717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:01.804516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:01.892451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] MFA Rules not processed for user `059579e95d6648b1bcf77ae9d484cbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:01.893679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:02.162072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 887/1757] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:02.168254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:02.170563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:02.190721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b7c48-1d1f-4833-ac59-f1a1ae41b514 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:02.334289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:02.336211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:02.338977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:02.339504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:02.359038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:02.362219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee53a-0a8d-4aa9-9c8b-b42595f0485c service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:02.383821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 871/1758] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:02.660520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:02.662126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:02.695668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f4b6-dbd8-4a92-a25a-9748a304c308 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:02.711522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:02.712403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:02.712795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:02.715273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:02.720379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:02.721433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:02.721864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:02.742373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:02.744158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cfba5-cfb0-4e96-9c6e-5c4a6b56eda1 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:02.757777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] MFA Rules not processed for user `e6d1a1b1c3754f0d856df4ca7a8e0269`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:02.759651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:02.772368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 888/1759] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:02.869710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:02.870097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:02.870501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:02.923049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 872/1760] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:02.924934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:02.935445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:02.993418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] MFA Rules not processed for user `57c05c5ffe63471db0f0f9e87df9370e`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:02.998184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:03.196060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671baf3-09fc-49d9-ad9d-aed73b3b3be5 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:03.216557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:03.217468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:03.218011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:03.218293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] PATH_INFO: `/v3/projects/19a439e68ea94098a5faa727f442656c` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:03.223584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a439e68ea94098a5faa727f442656c)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:03.225994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:03.250963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 889/1761] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:03.252104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:03.287661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651fc96-9c2f-4c68-addd-35fad87c3eaf None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:03.304497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:03.305500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:03.305779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:03.306050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] PATH_INFO: `/v3/users/059579e95d6648b1bcf77ae9d484cbbc` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:03.309060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=059579e95d6648b1bcf77ae9d484cbbc)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:03.310974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:03.398665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a439e68ea94098a5faa727f442656c', 'request_id': 'req-718177c8-65cf-4d40-aa81-0367b874ee33'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.424147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a439e68ea94098a5faa727f442656c', 'request_id': 'req-718177c8-65cf-4d40-aa81-0367b874ee33'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.441349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a439e68ea94098a5faa727f442656c', 'request_id': 'req-718177c8-65cf-4d40-aa81-0367b874ee33'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.443428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059579e95d6648b1bcf77ae9d484cbbc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.462986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059579e95d6648b1bcf77ae9d484cbbc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.466363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] The token cache is being invalidate because project 19a439e68ea94098a5faa727f442656c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:03.466935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.468057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.470019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 873/1762] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:02 2022] DELETE /identity/v3/projects/19a439e68ea94098a5faa727f442656c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:03.477217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:03.482652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:03.490665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059579e95d6648b1bcf77ae9d484cbbc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.491818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059579e95d6648b1bcf77ae9d484cbbc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.492866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af602948-0e7a-436f-b0fb-7eb1e89cb11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059579e95d6648b1bcf77ae9d484cbbc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.514908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 890/1763] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:03 2022] DELETE /identity/v3/users/059579e95d6648b1bcf77ae9d484cbbc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:03.519102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:03.519724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:03.520173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:03.549809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:03.552381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:03.684370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 891/1764] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:03.689862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718177c8-65cf-4d40-aa81-0367b874ee33 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:03.702001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:03.704442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:03.705545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:03.705935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] PATH_INFO: `/v3/users/e9b85f39a7ec4690ab231dccfc6be7d3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:03.709404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:03.710208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b85f39a7ec4690ab231dccfc6be7d3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:03.711238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:03.715395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:03.833175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b85f39a7ec4690ab231dccfc6be7d3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.834508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b85f39a7ec4690ab231dccfc6be7d3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.834961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b85f39a7ec4690ab231dccfc6be7d3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.862340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b85f39a7ec4690ab231dccfc6be7d3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.865346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54ef0a-4693-4415-8fdc-008450d6d39d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:03.870249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:03.871230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:03.871693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:03.872150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:03.874957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-67cc69aa-39be-47c4-87bc-4aca3f2c13e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b85f39a7ec4690ab231dccfc6be7d3'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:03.875080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:03.894922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:03.896715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:03.899943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 874/1765] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:03 2022] DELETE /identity/v3/users/e9b85f39a7ec4690ab231dccfc6be7d3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:03.911337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 892/1766] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:04.399663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:04.400067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:04.400316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:04.430716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] MFA Rules not processed for user `65620fcd12544f7094440d60b094cfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:04.434526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:04.561272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 875/1767] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:04.834037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:04.835897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:04.850939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be54-f824-4414-8dec-7c3ffc964174 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:04.923706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:04.925377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:04.982338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:04.983287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:04.983617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:04.984206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] PATH_INFO: `/v3/projects/1fec36045ac348f4a44223605f9bdb13` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:04.985707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fec36045ac348f4a44223605f9bdb13)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:04.988181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.045368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fec36045ac348f4a44223605f9bdb13', 'request_id': 'req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.052212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fec36045ac348f4a44223605f9bdb13', 'request_id': 'req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.064468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fec36045ac348f4a44223605f9bdb13', 'request_id': 'req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.082090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] The token cache is being invalidate because project 1fec36045ac348f4a44223605f9bdb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:05.082605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.083513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c6d9c36-4f8b-4bb3-b686-b95d49fa98d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.085599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 893/1768] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:04 2022] DELETE /identity/v3/projects/1fec36045ac348f4a44223605f9bdb13 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:05.090716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178e31-61f6-45b5-ae05-7a57884dc4e5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.091003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178e31-61f6-45b5-ae05-7a57884dc4e5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.091278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178e31-61f6-45b5-ae05-7a57884dc4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.126728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-28178e31-61f6-45b5-ae05-7a57884dc4e5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:05.128035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-28178e31-61f6-45b5-ae05-7a57884dc4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.208985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 894/1769] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:05.218775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.219066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.219723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.254834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:05.255261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.264905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f1f75-f154-474c-8fa2-c6cb86fd8998 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.270042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 895/1770] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:05.270937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.278605 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.279639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.280040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.280424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] PATH_INFO: `/v3/projects/3742a9df0c124138965b8c325a54f675` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.282217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3742a9df0c124138965b8c325a54f675)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.284578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.290579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebfd5d-259f-4ccb-8169-a19ee1b2778c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.297408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.297873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.298088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.298339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.299640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:05.299994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.301867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.315254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 896/1771] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:05.319715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.330246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4f5b-df62-4ff0-9978-b4e8bbe5c5aa admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.335272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.336109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.336398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.336674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.337366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.340167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.352743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3742a9df0c124138965b8c325a54f675', 'request_id': 'req-f1862189-486d-424b-9f0a-172e7a3751f9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.372264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3742a9df0c124138965b8c325a54f675', 'request_id': 'req-f1862189-486d-424b-9f0a-172e7a3751f9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.386479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3742a9df0c124138965b8c325a54f675', 'request_id': 'req-f1862189-486d-424b-9f0a-172e7a3751f9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.387580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 897/1772] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/projects => generated 407 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:05.391895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.413836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] The token cache is being invalidate because project 3742a9df0c124138965b8c325a54f675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:05.414202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.415404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f1862189-486d-424b-9f0a-172e7a3751f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:05.418984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 876/1773] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:04 2022] DELETE /identity/v3/projects/3742a9df0c124138965b8c325a54f675 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:05.425560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6a65-334c-47ab-8a52-169987e8b4f2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.426100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6a65-334c-47ab-8a52-169987e8b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.426526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6a65-334c-47ab-8a52-169987e8b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.453725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4a8e6a65-334c-47ab-8a52-169987e8b4f2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:05.454942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4a8e6a65-334c-47ab-8a52-169987e8b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.505357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212c33-b642-42ef-83f4-3c95f10fdb92 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.511562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.512537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.512829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.513097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.514518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.517999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.531642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 877/1774] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:05.539689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.540002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.540276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.551210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 898/1775] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/users => generated 304 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:05.552388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.554730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.562339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:05.564241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.574918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ce1d-0f34-47a0-8772-09b77395763d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.582465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.582707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 878/1776] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:05.583542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.584010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.584386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.585214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.586781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.587207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.602446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 899/1777] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:05.602927 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6031022-c4cf-4060-970f-a6bde5be779a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.603905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.610789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.611500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.611803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.612155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.612894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:05.613204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.614853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.617831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d47b-e752-4f37-b675-8f1855a4cec8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.624025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.625193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.625711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.626754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.627683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.630467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.634030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 879/1778] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:05.638069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.642462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 900/1779] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:05.647837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.647958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a2a6c-5006-43ea-bf93-be4ba00bd7c9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.653275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.654212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.658980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.659447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.660308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.663248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.676183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a586f-526b-4f83-a01b-df1db121ee3e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.696728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.697850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.698253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.698723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] PATH_INFO: `/v3/projects/4f0d5d420f3e439d97ac0b1580c7f9f5/users/79b7876ab1c640e78a118b371493408d/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.716583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 880/1780] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:05.719203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.728122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0d5d420f3e439d97ac0b1580c7f9f5, user_id=79b7876ab1c640e78a118b371493408d, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.731164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb832-cebb-40f2-b4b3-68aa226bc9b5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.759239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 901/1781] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:05 2022] PUT /identity/v3/projects/4f0d5d420f3e439d97ac0b1580c7f9f5/users/79b7876ab1c640e78a118b371493408d/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:05.767201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.767500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.767802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.801797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] MFA Rules not processed for user `79b7876ab1c640e78a118b371493408d`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:05.803349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:05.805088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5000-33ff-4204-859e-76801fb2679e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.866134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.866837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.867150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.867490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.868193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.870635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.888774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 902/1782] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:05.890954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.914869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f5af-1ef4-408c-81b5-a3586098e9a9 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.920335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.921918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.926903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.927308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.928166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.928580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 881/1783] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:05.930980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:05.931921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:05.954553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c549-32c3-4747-b35c-247f9cac4154 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:05.969090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:05.970580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:05.971908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:05.972772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:05.982244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:05.982244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.009028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 903/1784] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:05 2022] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:06.010666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.022241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 882/1785] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:06.026446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.044658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596ca4-f9f0-494c-87dd-70116cdb698b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.142693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890262-02b9-4765-ba3d-aaee9c6e3aca admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.150393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.151574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.152280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.152780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.153727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.156302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.159921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.160617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.160900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.161398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.162756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.166218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.182872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 883/1786] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:06.184115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.186840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.187980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 904/1787] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:06 2022] POST /identity/v3/users => generated 310 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:06.189190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.200819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704253e-9f66-4c85-b084-b890c5bcae2a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.204162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b101c-0117-4500-a9eb-3e75c4e41e8b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.208279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.209178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.209455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.209724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] PATH_INFO: `/v3/projects/ff8a57b524c543adbf3eb808b712fe13/users/1077769062b144d792a6d3cc846612ab/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.210189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.212810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.213250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.213568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] PATH_INFO: `/v3/users/caf074c5383c4473bba09aebd29f9f4f` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.214974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf074c5383c4473bba09aebd29f9f4f)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.217069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.226585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8a57b524c543adbf3eb808b712fe13, user_id=1077769062b144d792a6d3cc846612ab, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.229416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.244035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 905/1788] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:06 2022] PUT /identity/v3/projects/ff8a57b524c543adbf3eb808b712fe13/users/1077769062b144d792a6d3cc846612ab/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.245197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.268451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf074c5383c4473bba09aebd29f9f4f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.269262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf074c5383c4473bba09aebd29f9f4f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.270008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf074c5383c4473bba09aebd29f9f4f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.287919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf074c5383c4473bba09aebd29f9f4f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.296703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-408d1361-1e65-48e6-8528-e881e470b0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf074c5383c4473bba09aebd29f9f4f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.310067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 884/1789] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:06 2022] DELETE /identity/v3/users/caf074c5383c4473bba09aebd29f9f4f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.311477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.311793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.312070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.322198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29b89-bc7e-4100-b569-c84f7f3ee498 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.354175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] MFA Rules not processed for user `1077769062b144d792a6d3cc846612ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:06.357086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.404153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.404829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.405594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.406990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.406990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.408230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.424255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 906/1790] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:06.425161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.427399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.442200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5c54-a1af-4090-88fd-94c2ebd51371 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.448424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.449767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.450138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.450602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] PATH_INFO: `/v3/projects/2c4a675e1431457b9f0928c35d2aba12/users/23eb4ccddc164dcd892d18a01b4154bd/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.453786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 885/1791] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:06.458589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.460407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.476470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b6df-ac2a-4e82-a459-4bdfc4f3a45a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.483085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.484082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.484596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.485201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.486277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.490049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.490907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4a675e1431457b9f0928c35d2aba12, user_id=23eb4ccddc164dcd892d18a01b4154bd, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.497468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.515388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 907/1792] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:06 2022] PUT /identity/v3/projects/2c4a675e1431457b9f0928c35d2aba12/users/23eb4ccddc164dcd892d18a01b4154bd/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.519326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.529910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 886/1793] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:06 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:06.533579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.610003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3942f-c1b3-4f0b-91b1-a851d0bcad02 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.617635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.618371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.618874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.619153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.620383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.620603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432c94-bab1-40e9-8871-d3dce4b152eb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.622081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.627181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.628151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.628980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.629401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.630271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.632446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.634382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 908/1794] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:06.635096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.637195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.658867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25f32-4473-46f0-aa49-d151379804e7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.659077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 887/1795] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:06 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:06.659077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.661303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.662230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.662508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.662776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] PATH_INFO: `/v3/projects/3cf350d6bf09489a8c347e49132a0015` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.664012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf350d6bf09489a8c347e49132a0015)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.666169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.667082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5b98-79eb-4473-a277-7e71d8ebe62e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.671558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.672559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.672841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.673109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] PATH_INFO: `/v3/projects/2c4a675e1431457b9f0928c35d2aba12/users/23eb4ccddc164dcd892d18a01b4154bd/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.675035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4a675e1431457b9f0928c35d2aba12, user_id=23eb4ccddc164dcd892d18a01b4154bd, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.677686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.689372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 888/1796] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:06 2022] PUT /identity/v3/projects/2c4a675e1431457b9f0928c35d2aba12/users/23eb4ccddc164dcd892d18a01b4154bd/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.690476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.713250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf350d6bf09489a8c347e49132a0015', 'request_id': 'req-56cdafee-579e-4dd1-929e-526139025e69'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.719829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf350d6bf09489a8c347e49132a0015', 'request_id': 'req-56cdafee-579e-4dd1-929e-526139025e69'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.729616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf350d6bf09489a8c347e49132a0015', 'request_id': 'req-56cdafee-579e-4dd1-929e-526139025e69'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.742327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] The token cache is being invalidate because project 3cf350d6bf09489a8c347e49132a0015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:06.742751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.743498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-56cdafee-579e-4dd1-929e-526139025e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.745536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 909/1797] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:06 2022] DELETE /identity/v3/projects/3cf350d6bf09489a8c347e49132a0015 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.746909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.747330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.747706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.764681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc390e6-c328-4b10-90c5-c43044f0203c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.776999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] MFA Rules not processed for user `23eb4ccddc164dcd892d18a01b4154bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:06.778641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.825498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.826200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.826483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.826759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.827487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.829186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.839023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 889/1798] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:06.839880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.841536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.854369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 910/1799] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:06.854369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.854369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.854662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71c818-1f0c-41f5-ac5b-350df07c4213 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.867980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.868860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.869134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.869402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] PATH_INFO: `/v3/users/57c05c5ffe63471db0f0f9e87df9370e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.870573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c05c5ffe63471db0f0f9e87df9370e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.872590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.876412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e3ad5-d9c7-451d-b4cd-5e7eaa73f3da None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:06.881171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:06.882067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:06.882356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:06.882634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] PATH_INFO: `/v3/projects/6da2b307acf6417d9673dc2896528ae4/users/3068ae108dde472e81824ec60ec18d63/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:06.897491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da2b307acf6417d9673dc2896528ae4, user_id=3068ae108dde472e81824ec60ec18d63, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:06.900531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:06.915933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 911/1800] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:06 2022] PUT /identity/v3/projects/6da2b307acf6417d9673dc2896528ae4/users/3068ae108dde472e81824ec60ec18d63/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.916719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.919984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.924414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c05c5ffe63471db0f0f9e87df9370e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.925279 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c05c5ffe63471db0f0f9e87df9370e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.925946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c05c5ffe63471db0f0f9e87df9370e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.942237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c05c5ffe63471db0f0f9e87df9370e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.950554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c05c5ffe63471db0f0f9e87df9370e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:06.963435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 890/1801] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:06 2022] DELETE /identity/v3/users/57c05c5ffe63471db0f0f9e87df9370e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:06.964334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:06.965770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:06.977958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c432cb-7238-4cc5-b8f6-878edfad1812 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.040568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.041396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.041777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.042155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.044639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.056679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d13a6-7172-4294-9703-b53d6e169cc7 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.062610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.063903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.064291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.064663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.065537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.067308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.081827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 891/1802] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:07.088005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.109259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85af1-c534-41d0-8db5-d5ff33103589 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.114986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.115991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.116331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.116659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] PATH_INFO: `/v3/projects/6da2b307acf6417d9673dc2896528ae4/users/3068ae108dde472e81824ec60ec18d63/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.119857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da2b307acf6417d9673dc2896528ae4, user_id=3068ae108dde472e81824ec60ec18d63, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.121352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.122104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.123390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b224-1944-44d0-b5be-1b0241bb0f7b service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.133175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 912/1803] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:07.140729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 892/1804] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:07 2022] PUT /identity/v3/projects/6da2b307acf6417d9673dc2896528ae4/users/3068ae108dde472e81824ec60ec18d63/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:07.152061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.152403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.152774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.170196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.172666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.190167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] MFA Rules not processed for user `3068ae108dde472e81824ec60ec18d63`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:07.191812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.278964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 913/1805] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:07.286468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db5954-0ceb-4dce-adc8-cec5089e8878 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.290997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.291888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.292152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.292414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] PATH_INFO: `/v3/projects/2928f9a9001b49ea99a85be5ca592c5e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.293612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2928f9a9001b49ea99a85be5ca592c5e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.294716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.295496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.296500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.348227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2928f9a9001b49ea99a85be5ca592c5e', 'request_id': 'req-9476124a-d7f5-4431-ba91-9a27448f7e0c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:07.356308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2928f9a9001b49ea99a85be5ca592c5e', 'request_id': 'req-9476124a-d7f5-4431-ba91-9a27448f7e0c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:07.361225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8765b99-e53b-46e6-932c-1af1eda37eb8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.361543 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2928f9a9001b49ea99a85be5ca592c5e', 'request_id': 'req-9476124a-d7f5-4431-ba91-9a27448f7e0c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:07.372511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] The token cache is being invalidate because project 2928f9a9001b49ea99a85be5ca592c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:07.372814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:07.373505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:07.375182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 893/1806] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:07 2022] DELETE /identity/v3/projects/2928f9a9001b49ea99a85be5ca592c5e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:07.375827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.377107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.409049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.409702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.409986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.410261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.412157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.431239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476124a-d7f5-4431-ba91-9a27448f7e0c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.438591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.439347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.439643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.439933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.441863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.475174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.476795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72a093-2844-43f8-b0dc-ea91efc0e69f service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.486517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 914/1807] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:07.487839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.488129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.488380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.506578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:07.506999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.507813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.508562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7c822-6d80-4e71-bc3a-3f1c68fc0e7e service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.517612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 894/1808] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:07.577845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 915/1809] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:07.586838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.588781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.588781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.594591 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.596127 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.614054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6db94-b1f7-4ceb-96b5-fa33cd0d5c2d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.615311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:07.617485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.618579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.619229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.619510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.619801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.621790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:07.631715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 895/1810] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:07.636540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.646108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68bc0-c1e9-4ea3-a04c-63f35d1d4a48 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.655878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.656477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.656743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.657017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.657793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:07.658095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.663024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.682132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 896/1811] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:07.684145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.696984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62ff5-cec8-4c07-97a1-a704b7feb24b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.702656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.703499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.704111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.704637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.705446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.707572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.712350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.713881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.723902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 916/1812] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:07.741869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 897/1813] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:07 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:07.743402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.757251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097bc-fb8d-4337-afe1-cb2d7303ba2b service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.841509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.841784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.842101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.842401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.843140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.845699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.876014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 917/1814] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:07 2022] POST /identity/v3/users => generated 279 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:07.879840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.892955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0aac-8d21-4384-8fd2-49731ac3e35f admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.899447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.900244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.900548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.900828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.901611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.903295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.918552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 898/1815] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:07.922590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.934153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab07d-5188-45bb-aa68-2a73f8e87efe admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.946099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.947324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.947968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.948665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:07.949567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:07.951887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4c20-0a20-494f-9c0a-d6882be9517d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:07.968143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 918/1816] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:07.972432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:07.985235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6823e78-61b5-4a19-9cf3-a2ed4d7049d9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:07.990266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:07.991472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:07.991891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:07.992444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] PATH_INFO: `/v3/projects/5522599390ce4661ba7e83c19c9c025a/users/335aa77488dd495298a36b4a6dbb7bb3/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.008068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5522599390ce4661ba7e83c19c9c025a, user_id=335aa77488dd495298a36b4a6dbb7bb3, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.021559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.041413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 899/1817] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:07 2022] PUT /identity/v3/projects/5522599390ce4661ba7e83c19c9c025a/users/335aa77488dd495298a36b4a6dbb7bb3/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:08.056233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.056585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.056871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.087882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] MFA Rules not processed for user `335aa77488dd495298a36b4a6dbb7bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:08.089087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:08.156544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 919/1818] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:08.161118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.221815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847e969-95f0-425a-add5-37e962c70117 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.226415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.227123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.227394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.227663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.228373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.230550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.256889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 900/1819] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:08 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:08.260674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.271153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b3763-d81d-4066-b696-74fc5d9a1330 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.325655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.326334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.326612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.326885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.327568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.329584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.351370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 920/1820] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:08 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:08.355830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.366005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331398d-5f49-42e1-9dc7-c3ff6b5cb489 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.371510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.372214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.372492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.372760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.373477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.375071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.385818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 901/1821] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:08.390133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.400966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dd612-5bbf-442a-b53c-cf4cf8e94a5c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.406468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.407409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.407623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.407924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] PATH_INFO: `/v3/projects/5a93d6e8977248579dc1e0dade6c3125/users/0c2aa1c6b4294093a04bd62c5ad49fd8/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.424938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a93d6e8977248579dc1e0dade6c3125, user_id=0c2aa1c6b4294093a04bd62c5ad49fd8, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.427600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.445120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 921/1822] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:08 2022] PUT /identity/v3/projects/5a93d6e8977248579dc1e0dade6c3125/users/0c2aa1c6b4294093a04bd62c5ad49fd8/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:08.450502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.463801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745986-2ee9-4f58-b7c4-881ef657ade7 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.518475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.519131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.519403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.519672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.520410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.521992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9a1cd-a800-44da-aa32-a892630f873e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.531798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 902/1823] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:08.536111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.546384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d248671-f290-451c-88f5-55798438bfdd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.551359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.552256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.552533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.552804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] PATH_INFO: `/v3/projects/5a93d6e8977248579dc1e0dade6c3125/users/0c2aa1c6b4294093a04bd62c5ad49fd8/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.554929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a93d6e8977248579dc1e0dade6c3125, user_id=0c2aa1c6b4294093a04bd62c5ad49fd8, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.557563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.567923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 922/1824] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:08 2022] PUT /identity/v3/projects/5a93d6e8977248579dc1e0dade6c3125/users/0c2aa1c6b4294093a04bd62c5ad49fd8/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:08.584404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.584710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.585048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.613081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] MFA Rules not processed for user `0c2aa1c6b4294093a04bd62c5ad49fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:08.614293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:08.687022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 903/1825] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:08.699111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:08.884526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbed9-c343-428b-a0d4-5075d55867ae admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:08.889000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:08.889649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:08.889926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:08.890194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:08.900112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:08.901537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:08.912509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 923/1826] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:08.989333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:09.002023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7c6d-8517-4ce4-8829-614d3b84ea2f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:09.005545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:09.006187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:09.006458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:09.006754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:09.066980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:09.068893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308f05-4241-4144-864f-44341cd95225 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:09.078816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 904/1827] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:13.997098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:13.998684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:14.163244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711a0b5-7413-484a-8d2a-7f4fa71c3d38 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:14.178571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:14.179912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:14.186704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:14.187331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] PATH_INFO: `/v3/users/1077769062b144d792a6d3cc846612ab` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:14.189099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1077769062b144d792a6d3cc846612ab)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:14.191404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:14.298781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1077769062b144d792a6d3cc846612ab'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:14.313392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1077769062b144d792a6d3cc846612ab'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:14.322545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1077769062b144d792a6d3cc846612ab'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:14.323674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1077769062b144d792a6d3cc846612ab'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:14.324706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a695b9dd-6b76-4eec-933d-64c0e2e0ae9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1077769062b144d792a6d3cc846612ab'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:14.348444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 924/1828] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:13 2022] DELETE /identity/v3/users/1077769062b144d792a6d3cc846612ab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:14.349475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4632c-1e44-4814-9f6e-6bd07c50b35d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:14.349960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4632c-1e44-4814-9f6e-6bd07c50b35d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:14.350076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4632c-1e44-4814-9f6e-6bd07c50b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:14.400275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6ca4632c-1e44-4814-9f6e-6bd07c50b35d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:14.401554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6ca4632c-1e44-4814-9f6e-6bd07c50b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:14.521715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 905/1829] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:14.568787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:14.569224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:14.569421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:14.571272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 925/1830] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:54:14.586962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e059b1-710b-43ba-a2fb-332f086d8f8d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:14.587254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e059b1-710b-43ba-a2fb-332f086d8f8d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:14.587534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e059b1-710b-43ba-a2fb-332f086d8f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:14.618615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f4e059b1-710b-43ba-a2fb-332f086d8f8d None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:14.621961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f4e059b1-710b-43ba-a2fb-332f086d8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:14.692864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:14.695295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:14.770011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 906/1831] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:14.806474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d56e8-af2a-492c-a99c-2081020df083 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:14.811496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:14.812587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:14.813004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:14.813486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:14.826573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:14.828039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef679c-4015-49fd-b0d7-24628668290e service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:14.839950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 926/1832] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:15.295306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:15.295552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:15.295910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:15.297510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 907/1833] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:54:15.307064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:15.307064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:15.307614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:15.328604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:15.330487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:15.343517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 927/1834] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:15.366730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:15.368582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:15.388572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f18c-8383-4818-843c-9e2c089f83af None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:15.395403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:15.396179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:15.396455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:15.396889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:15.408250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:15.410707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:15.422503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 908/1835] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:15.498747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:15.510391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ea85-0d3a-45ad-a049-022a323148c8 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:15.517066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419754-00fb-467b-b709-5b991884b275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:15.517716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419754-00fb-467b-b709-5b991884b275 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:15.517993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419754-00fb-467b-b709-5b991884b275 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:15.518265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419754-00fb-467b-b709-5b991884b275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:15.527057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419754-00fb-467b-b709-5b991884b275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:15.528651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419754-00fb-467b-b709-5b991884b275 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:15.538999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 928/1836] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:15.815580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:15.817348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:15.840254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401d9b-54e1-441a-874c-1d1afb64ab22 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:15.846926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:15.848751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:15.849441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:15.849992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] PATH_INFO: `/v3/projects/ff8a57b524c543adbf3eb808b712fe13` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:15.852810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8a57b524c543adbf3eb808b712fe13)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:15.855094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:15.934245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8a57b524c543adbf3eb808b712fe13', 'request_id': 'req-5b09169d-bde7-4d46-94a2-c7560fc729ab'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:15.950969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8a57b524c543adbf3eb808b712fe13', 'request_id': 'req-5b09169d-bde7-4d46-94a2-c7560fc729ab'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:15.968422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8a57b524c543adbf3eb808b712fe13', 'request_id': 'req-5b09169d-bde7-4d46-94a2-c7560fc729ab'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.022042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] The token cache is being invalidate because project ff8a57b524c543adbf3eb808b712fe13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:16.022367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.028608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.048454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 909/1837] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:15 2022] DELETE /identity/v3/projects/ff8a57b524c543adbf3eb808b712fe13 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:16.052389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419754-00fb-467b-b709-5b991884b275 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:16.067590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419754-00fb-467b-b709-5b991884b275 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:16.218084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:16.219607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:16.220510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:16.221883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] PATH_INFO: `/v3/users/3068ae108dde472e81824ec60ec18d63` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:16.223919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3068ae108dde472e81824ec60ec18d63)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:16.228798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:16.320163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3068ae108dde472e81824ec60ec18d63'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.334213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3068ae108dde472e81824ec60ec18d63'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.356377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3068ae108dde472e81824ec60ec18d63'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.358170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3068ae108dde472e81824ec60ec18d63'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.361609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3068ae108dde472e81824ec60ec18d63'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.433090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 929/1838] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:16 2022] DELETE /identity/v3/users/3068ae108dde472e81824ec60ec18d63 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:16.709115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:16.711033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:16.724396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09169d-bde7-4d46-94a2-c7560fc729ab admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:16.796825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:16.797068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:16.798150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:16.798539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:16.798902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] PATH_INFO: `/v3/users/79b7876ab1c640e78a118b371493408d` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:16.799646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:16.800338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b7876ab1c640e78a118b371493408d)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:16.802507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:16.817280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53d29-988f-423c-b5e2-e79b25d0ac13 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:16.824455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:16.825927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:16.826646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:16.827038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] PATH_INFO: `/v3/projects/6da2b307acf6417d9673dc2896528ae4` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:16.829093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da2b307acf6417d9673dc2896528ae4)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:16.831224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:16.864857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b7876ab1c640e78a118b371493408d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.865815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b7876ab1c640e78a118b371493408d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.866496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b7876ab1c640e78a118b371493408d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.880323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b7876ab1c640e78a118b371493408d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.882024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da2b307acf6417d9673dc2896528ae4', 'request_id': 'req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.889349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da2b307acf6417d9673dc2896528ae4', 'request_id': 'req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.889680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d8834534-5b0b-4425-ab68-93308a87c9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b7876ab1c640e78a118b371493408d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.898446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da2b307acf6417d9673dc2896528ae4', 'request_id': 'req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.907243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 910/1839] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:16 2022] DELETE /identity/v3/users/79b7876ab1c640e78a118b371493408d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:16.909356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:16.909638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:16.910764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:16.911829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] The token cache is being invalidate because project 6da2b307acf6417d9673dc2896528ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:16.912128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.912925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-215fc505-4f54-4e8d-b8b3-2944ce70e1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:16.915792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 930/1840] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:16 2022] DELETE /identity/v3/projects/6da2b307acf6417d9673dc2896528ae4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:16.919715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd08dc-ec19-4840-b47c-40b85b4b363c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:16.920117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd08dc-ec19-4840-b47c-40b85b4b363c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:16.920304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd08dc-ec19-4840-b47c-40b85b4b363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:16.938346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:16.939579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:16.948889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5dcd08dc-ec19-4840-b47c-40b85b4b363c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:16.951549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5dcd08dc-ec19-4840-b47c-40b85b4b363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:17.004514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 911/1841] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:17.019723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.021497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:17.063427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 931/1842] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:17.070567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.071003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.071421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.120841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28341-0346-41d9-833d-075cf3f34d9a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.121878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:17.123118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:17.126161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.126839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.127117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.127482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.138045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.139664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.141008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 932/1843] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:17.145872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.155609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce412d0-c640-4226-a6fb-597e492ab45e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.156300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 912/1844] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:17.176186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.177764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.178332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.178916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.180391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:17.180878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.185331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.206227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 933/1845] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:17.211753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.226567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7952ea-aacf-4376-9d25-a2c27c370a88 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.244231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.245069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.245355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.245633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.246376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.248494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.291333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 913/1846] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:17 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:17.295419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.308315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530935f-08b5-4285-9313-32ff5630537a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.418313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.419534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.420166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.420516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.422121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.424619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.449027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 934/1847] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:17 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:17.453467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.476009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6de0-98c4-456f-9ef6-67bb39a5c7af admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.488018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.488706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.488988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.489261 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.491689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.493483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.553052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 914/1848] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:17.559636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.588474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3656-b3b3-4d96-b095-52fbed345e32 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.602833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.605928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.606707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.607701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.609722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.613382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.615864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.617670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:17.648172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625921e-42d3-471a-aad0-0b2d1b3ed83a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.650230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 935/1849] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:17.654923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.670089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.670993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.671292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.671571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] PATH_INFO: `/v3/projects/4f0d5d420f3e439d97ac0b1580c7f9f5` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.676637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0d5d420f3e439d97ac0b1580c7f9f5)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.678847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.685598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eaac-506a-4154-93f8-983b08bb4194 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:17.704628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:17.705851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.706196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.712164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] PATH_INFO: `/v3/projects/70de3e5ac0bd4dfca4865d3570a83635/users/14ef54db7f2c486790e9495de1c4902b/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.754377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70de3e5ac0bd4dfca4865d3570a83635, user_id=14ef54db7f2c486790e9495de1c4902b, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:17.761194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8511b-1a74-4b3c-8857-e5207155accc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:17.791195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 936/1850] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:17 2022] PUT /identity/v3/projects/70de3e5ac0bd4dfca4865d3570a83635/users/14ef54db7f2c486790e9495de1c4902b/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:17.804991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0d5d420f3e439d97ac0b1580c7f9f5', 'request_id': 'req-3ec6760f-d404-43c1-8ce5-af65696da31b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:17.807310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:17.808323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:17.811466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:17.818699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0d5d420f3e439d97ac0b1580c7f9f5', 'request_id': 'req-3ec6760f-d404-43c1-8ce5-af65696da31b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:17.834601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0d5d420f3e439d97ac0b1580c7f9f5', 'request_id': 'req-3ec6760f-d404-43c1-8ce5-af65696da31b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:17.865580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] The token cache is being invalidate because project 4f0d5d420f3e439d97ac0b1580c7f9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:17.866069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:17.867731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:17.874943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 915/1851] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:17 2022] DELETE /identity/v3/projects/4f0d5d420f3e439d97ac0b1580c7f9f5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:17.875964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:17.878978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:17.882889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] MFA Rules not processed for user `14ef54db7f2c486790e9495de1c4902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:17.889017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.005510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 937/1852] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:18.010483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.012114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.012839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6760f-d404-43c1-8ce5-af65696da31b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.125293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684eb38-b2f4-48b6-9a87-3421a78d44f1 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.131240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.132800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.133097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.137672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.138674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.141042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.174330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.175662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.176222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.176634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] PATH_INFO: `/v3/users/23eb4ccddc164dcd892d18a01b4154bd` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.181881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23eb4ccddc164dcd892d18a01b4154bd)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.185993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.196615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 938/1853] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:18.204013 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.256533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23eb4ccddc164dcd892d18a01b4154bd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.257195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23eb4ccddc164dcd892d18a01b4154bd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.257851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23eb4ccddc164dcd892d18a01b4154bd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.273844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23eb4ccddc164dcd892d18a01b4154bd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.284680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa41-8fd3-4f81-8b31-ae5f911a37d5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.288265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23eb4ccddc164dcd892d18a01b4154bd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.291974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.292733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.292924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.293230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.295082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.297465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.313991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 916/1854] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:17 2022] DELETE /identity/v3/users/23eb4ccddc164dcd892d18a01b4154bd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:18.343761 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 939/1855] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:18.347562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.349154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.431677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d8be-b15e-4e3a-98fc-24d7245a4d83 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.437010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.437676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.437967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.438580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.439262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.441073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.458348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.465524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 917/1856] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:18.469572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5d5f-aa01-4017-963e-c4cfd28b674c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.475178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.475882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.476645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.477087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.478050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.484472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81129-5f2b-4cc3-9f4c-3f047412bb55 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.497781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 940/1857] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:18.501697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.512803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a642-78d5-42f0-9eca-a8d06aabbba4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.518139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.520046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.520349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.520848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] PATH_INFO: `/v3/projects/c914c9b7691c4497b0eb1a2b28481ffc/users/9bc82643d1d4401b929f06fb33cb778e/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.541343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c914c9b7691c4497b0eb1a2b28481ffc, user_id=9bc82643d1d4401b929f06fb33cb778e, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.544530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.570253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 918/1858] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:18 2022] PUT /identity/v3/projects/c914c9b7691c4497b0eb1a2b28481ffc/users/9bc82643d1d4401b929f06fb33cb778e/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:18.575150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b425-708f-4050-8147-78915301a512 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.575620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b425-708f-4050-8147-78915301a512 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.575931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b425-708f-4050-8147-78915301a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.608634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5283b425-708f-4050-8147-78915301a512 None None] MFA Rules not processed for user `9bc82643d1d4401b929f06fb33cb778e`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:18.610038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5283b425-708f-4050-8147-78915301a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.655089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.657090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.705273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 941/1859] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:18.706517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283b425-708f-4050-8147-78915301a512 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.739317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6d48f-13e8-4198-bbab-698b5efdc2b3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.744857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.745993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.746488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.746974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] PATH_INFO: `/v3/projects/2c4a675e1431457b9f0928c35d2aba12` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.748393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4a675e1431457b9f0928c35d2aba12)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.750646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.778009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283b425-708f-4050-8147-78915301a512 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.787570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:18.788239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.788710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.788941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.790252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:18.792269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:18.808902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4a675e1431457b9f0928c35d2aba12', 'request_id': 'req-dd294756-a82f-4b54-8d8f-f3e39d4b5207'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.826338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 942/1860] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:18.826495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4a675e1431457b9f0928c35d2aba12', 'request_id': 'req-dd294756-a82f-4b54-8d8f-f3e39d4b5207'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.828978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:18.844848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4a675e1431457b9f0928c35d2aba12', 'request_id': 'req-dd294756-a82f-4b54-8d8f-f3e39d4b5207'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.861873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] The token cache is being invalidate because project 2c4a675e1431457b9f0928c35d2aba12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:18.862283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.863698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dd294756-a82f-4b54-8d8f-f3e39d4b5207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:18.866198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 919/1861] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:18 2022] DELETE /identity/v3/projects/2c4a675e1431457b9f0928c35d2aba12 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:18.870780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67819-29d4-463e-981c-af6bb617f739 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:18.871939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67819-29d4-463e-981c-af6bb617f739 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:18.872323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67819-29d4-463e-981c-af6bb617f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:18.899129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-58d67819-29d4-463e-981c-af6bb617f739 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:18.904442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-58d67819-29d4-463e-981c-af6bb617f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:18.988544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a05e-5ebc-4b7a-a02e-6251b3e74d62 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:18.994029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 920/1862] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:19.001922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.001922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.002181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.007747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.008584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.008993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.009360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.010742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.013960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.033220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:19.035246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:19.046292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 921/1863] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:19.047522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.064088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 943/1864] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:18 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:19.065230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.068273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485945e-5ca1-46d5-af3d-12fd3c1fb79d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.068882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:19.075594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.076520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.077472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.077750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.079504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:19.079859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.082301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.096148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47915b0-27d8-4aad-b98b-cbc715a45048 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.102888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.103830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.104333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.105193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.106151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.108026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.125147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 922/1865] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:19.138647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 944/1866] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:19.146352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.147456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.161947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada7d8-c011-4a51-95e7-775623614b66 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.182090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0c3f8-9f03-4b27-98ef-718bebfe3839 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.188282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.189205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.189665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.191671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.192783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.198375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.199657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.200789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.208154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.208657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] PATH_INFO: `/v3/projects/60545c57e7f14c149711b80bd15855e5/users/f0b28312153f41c58fdb5db0d75af823/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.265456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60545c57e7f14c149711b80bd15855e5, user_id=f0b28312153f41c58fdb5db0d75af823, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.271742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.291796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 923/1867] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:19 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:19.295553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.314901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 945/1868] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:19 2022] PUT /identity/v3/projects/60545c57e7f14c149711b80bd15855e5/users/f0b28312153f41c58fdb5db0d75af823/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:19.318861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.464180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f2fe-fce9-485d-930c-91164615a1c9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.477235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc624-c30f-43e6-9bee-275cb80739d6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.483020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.484544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.485014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.485397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.487012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.488699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.489153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.489849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.490129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.490411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.491100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.496073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.502047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 946/1869] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:19.507347 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.528577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748eae96-8bb2-4f40-9e51-9830e89e5225 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.537009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.537942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.542655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.542982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] PATH_INFO: `/v3/projects/60545c57e7f14c149711b80bd15855e5/users/f0b28312153f41c58fdb5db0d75af823/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.553336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60545c57e7f14c149711b80bd15855e5, user_id=f0b28312153f41c58fdb5db0d75af823, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.553756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 924/1870] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:19 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:19.556774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba101469-88c1-404a-a608-536b9dc787e0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.558002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.569591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a282-3c2a-466a-98d7-40a901ed3fac admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.576952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.576952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.577220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.577313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.578321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.581694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.595811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 947/1871] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:19 2022] PUT /identity/v3/projects/60545c57e7f14c149711b80bd15855e5/users/f0b28312153f41c58fdb5db0d75af823/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:19.602257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.602671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.602996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.617028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 925/1872] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:19.618292 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.639662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26320-9749-4f31-b733-cf360f6b3c9f admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.675623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] MFA Rules not processed for user `f0b28312153f41c58fdb5db0d75af823`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:19.677601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:19.717042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.717827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.718113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.718388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.719926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.721423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.737213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 926/1873] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:19.739146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.757878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba9c6-a692-4bc8-8d79-c80f37bded78 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.764465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.765576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.766027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.766438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] PATH_INFO: `/v3/projects/69c7c6b8f55f4595b3144c8abd512fa9/users/dc752d5e6b274018971e56ced0b45e72/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.781454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 948/1874] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:19.786401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c7c6b8f55f4595b3144c8abd512fa9, user_id=dc752d5e6b274018971e56ced0b45e72, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.788355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12ad35-538a-4500-931c-ade5c278af78 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.797418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.799339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:19.807936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 927/1875] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:19 2022] PUT /identity/v3/projects/69c7c6b8f55f4595b3144c8abd512fa9/users/dc752d5e6b274018971e56ced0b45e72/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:19.820158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.821198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.821544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.851897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] MFA Rules not processed for user `dc752d5e6b274018971e56ced0b45e72`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:19.853120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:19.863620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef71f-fb2f-40cb-b70a-9130b9f74a89 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:19.918857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:19.919578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:19.920177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:19.920307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:19.925768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 928/1876] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:19.932123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:19.981726 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:19.983455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:19.994616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 949/1877] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:20.054801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.056246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:20.061120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3609f-7785-48c5-b9d7-8fab8433b990 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.066046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.066875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.067517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.068038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.068710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037c3c-72bc-401b-8f54-6017821ad9fd service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.069019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.071272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.072851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.073571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.073914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.074251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.077017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:20.100537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 929/1878] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:19 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:20.104327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.150895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.153041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.168786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b86fb-0a86-4ac6-8c46-96378ca5a126 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.173948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.174867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.175213 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.175572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.176141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 950/1879] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:20.176683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.180747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.205161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 930/1880] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:20 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:20.209066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.223727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e108-5b79-4889-9e56-2173cf97288c service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.232993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.233670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.233950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.234276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.235003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.236980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.251927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 951/1881] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:20.253888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.265073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155bddb-5d1d-43e9-a948-3c97f457d7b1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.270454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.271450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.271700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.271997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] PATH_INFO: `/v3/projects/019df79a24a44a23b6dc7dba8a5c2327/users/961c55b5253b42bdb59511e7dcdb5050/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.288830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=019df79a24a44a23b6dc7dba8a5c2327, user_id=961c55b5253b42bdb59511e7dcdb5050, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.291664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.306638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 931/1882] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:20 2022] PUT /identity/v3/projects/019df79a24a44a23b6dc7dba8a5c2327/users/961c55b5253b42bdb59511e7dcdb5050/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:20.310452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.322091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980ce8-d1cc-44c8-bf70-523b110b68c1 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.386969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.387883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.388188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.388553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.389332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.391106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659ce41-ee39-4575-867f-bf210f1959d0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.402797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 952/1883] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:20.407745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.419464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44798f4-1144-4cdb-b16b-8ad157bf7efe admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.424820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.425710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.426025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.426239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] PATH_INFO: `/v3/projects/019df79a24a44a23b6dc7dba8a5c2327/users/961c55b5253b42bdb59511e7dcdb5050/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.428491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] RBAC: Authorizing `identity:create_grant(project_id=019df79a24a44a23b6dc7dba8a5c2327, user_id=961c55b5253b42bdb59511e7dcdb5050, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.431417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.442546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 932/1884] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:20 2022] PUT /identity/v3/projects/019df79a24a44a23b6dc7dba8a5c2327/users/961c55b5253b42bdb59511e7dcdb5050/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:20.453349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.453798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.454288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.485411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] MFA Rules not processed for user `961c55b5253b42bdb59511e7dcdb5050`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:20.486957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:20.578028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 953/1885] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:20.591272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:20.664338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffd1-64c7-402b-8f98-0b5b2eb866df admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:20.668741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:20.669546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:20.669826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:20.670096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:20.682251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:20.684791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:20.701487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 933/1886] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:21.098857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:21.110813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d0277-df0f-4436-9c67-8265ca88cefb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:21.114716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:21.115302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:21.115581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:21.115899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:21.193799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:21.195359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d392cc-7a22-4c3d-ab2c-3d539c2ceb64 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:21.215977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 954/1887] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:25.367818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:25.492994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8475-bb97-4dd2-9c90-f2b8721d9711 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:25.498733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:25.499737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:25.500123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:25.500459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] PATH_INFO: `/v3/users/14ef54db7f2c486790e9495de1c4902b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:25.501721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ef54db7f2c486790e9495de1c4902b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:25.503793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:25.588851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ef54db7f2c486790e9495de1c4902b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:25.590310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ef54db7f2c486790e9495de1c4902b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:25.591183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ef54db7f2c486790e9495de1c4902b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:25.608041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ef54db7f2c486790e9495de1c4902b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:25.618673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ef54db7f2c486790e9495de1c4902b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:25.634555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 934/1888] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:25 2022] DELETE /identity/v3/users/14ef54db7f2c486790e9495de1c4902b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:25.640000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:25.640485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:25.640562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:25.660746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:25.661769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:25.727944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 955/1889] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:25.737727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:25.739242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:25.796222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43438d-5815-418c-918c-651926c2cd77 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:25.799843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:25.800494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:25.800772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:25.801095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:25.810231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:25.811653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:25.821961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 935/1890] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:26.170994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:26.172507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:26.193698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e5b2-0dc4-4283-b19d-cb703de7617b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:26.201333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:26.202212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.202494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.202763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] PATH_INFO: `/v3/projects/70de3e5ac0bd4dfca4865d3570a83635` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.204237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70de3e5ac0bd4dfca4865d3570a83635)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:26.206271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:26.271501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70de3e5ac0bd4dfca4865d3570a83635', 'request_id': 'req-1c233de4-9c37-42a1-a34a-2985f7d651b9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.277283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70de3e5ac0bd4dfca4865d3570a83635', 'request_id': 'req-1c233de4-9c37-42a1-a34a-2985f7d651b9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.290532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70de3e5ac0bd4dfca4865d3570a83635', 'request_id': 'req-1c233de4-9c37-42a1-a34a-2985f7d651b9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.311329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] The token cache is being invalidate because project 70de3e5ac0bd4dfca4865d3570a83635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:26.312041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.312493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.315819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 956/1891] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:26 2022] DELETE /identity/v3/projects/70de3e5ac0bd4dfca4865d3570a83635 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:26.319207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:26.330297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb98da-7e79-45c4-9678-66448634ff16 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:26.398275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:26.399206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.399486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.399791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] PATH_INFO: `/v3/users/9bc82643d1d4401b929f06fb33cb778e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.400994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc82643d1d4401b929f06fb33cb778e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:26.402880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:26.453793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc82643d1d4401b929f06fb33cb778e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.454318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc82643d1d4401b929f06fb33cb778e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.455111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc82643d1d4401b929f06fb33cb778e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.467083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:26.468687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:26.470383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc82643d1d4401b929f06fb33cb778e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.479132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-bb18f31a-9498-4aad-bbc1-05f95c82a735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc82643d1d4401b929f06fb33cb778e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.483308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233de4-9c37-42a1-a34a-2985f7d651b9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:26.489026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:26.489978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.490348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.490626 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] PATH_INFO: `/v3/users/8cbc1fc5d06c497998053e7eba822643` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.491892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbc1fc5d06c497998053e7eba822643)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:26.492158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 936/1892] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:26 2022] DELETE /identity/v3/users/9bc82643d1d4401b929f06fb33cb778e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:26.494107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:26.541411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbc1fc5d06c497998053e7eba822643'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.550085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbc1fc5d06c497998053e7eba822643'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.557150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbc1fc5d06c497998053e7eba822643'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.557788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbc1fc5d06c497998053e7eba822643'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.558381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbc1fc5d06c497998053e7eba822643'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:26.576119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 957/1893] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:26 2022] DELETE /identity/v3/users/8cbc1fc5d06c497998053e7eba822643 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:26.580897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.581319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.581596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.599323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:26.600588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:26.677396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 937/1894] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:26.829077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:26.830690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:26.897458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9f2bb-11cd-4753-b48f-c67c5eb71a55 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:26.901967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:26.902661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.902935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.903206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.908921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:26.910594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:26.917914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:26.920031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:26.927340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a1a1-7dcb-48cb-a5d3-833b6c47b61d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:26.933395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:26.934269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:26.934545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:26.934815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] PATH_INFO: `/v3/projects/c914c9b7691c4497b0eb1a2b28481ffc` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:26.936363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c914c9b7691c4497b0eb1a2b28481ffc)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:26.946914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 958/1895] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:26.947845 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.001716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c914c9b7691c4497b0eb1a2b28481ffc', 'request_id': 'req-9bf659fa-10a4-437b-b842-d031e42274b5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.010796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c914c9b7691c4497b0eb1a2b28481ffc', 'request_id': 'req-9bf659fa-10a4-437b-b842-d031e42274b5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.016821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c914c9b7691c4497b0eb1a2b28481ffc', 'request_id': 'req-9bf659fa-10a4-437b-b842-d031e42274b5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.030198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] The token cache is being invalidate because project c914c9b7691c4497b0eb1a2b28481ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:27.030632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.031355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.033066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 938/1896] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:26 2022] DELETE /identity/v3/projects/c914c9b7691c4497b0eb1a2b28481ffc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:27.037112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.047676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84023963-0fa1-4f91-a6ff-0b035941a1df service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:27.111459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:27.112372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.112668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.113268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] PATH_INFO: `/v3/users/f0b28312153f41c58fdb5db0d75af823` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.114182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b28312153f41c58fdb5db0d75af823)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:27.116143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.166111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b28312153f41c58fdb5db0d75af823'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.174993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b28312153f41c58fdb5db0d75af823'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.182846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b28312153f41c58fdb5db0d75af823'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.183746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b28312153f41c58fdb5db0d75af823'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.184446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b28312153f41c58fdb5db0d75af823'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.213534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 959/1897] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:27 2022] DELETE /identity/v3/users/f0b28312153f41c58fdb5db0d75af823 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:27.340498 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.342142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.363098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf659fa-10a4-437b-b842-d031e42274b5 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:27.412807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.415619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.502260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:27.503208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.504322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.506283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] PATH_INFO: `/v3/projects/060b1e503fd44fb886374ccb0134a58e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.508799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060b1e503fd44fb886374ccb0134a58e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:27.511361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.524317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be067-38c0-4c1d-b714-95bd3cd4cf6c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:27.530336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:27.532202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.532592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.532967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] PATH_INFO: `/v3/users/dc752d5e6b274018971e56ced0b45e72` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.534689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc752d5e6b274018971e56ced0b45e72)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:27.536917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.625042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060b1e503fd44fb886374ccb0134a58e', 'request_id': 'req-73d3dc74-bf6c-4e14-b295-b2a3465066c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.634976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc752d5e6b274018971e56ced0b45e72'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.645039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060b1e503fd44fb886374ccb0134a58e', 'request_id': 'req-73d3dc74-bf6c-4e14-b295-b2a3465066c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.649220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc752d5e6b274018971e56ced0b45e72'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.651915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060b1e503fd44fb886374ccb0134a58e', 'request_id': 'req-73d3dc74-bf6c-4e14-b295-b2a3465066c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.660328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc752d5e6b274018971e56ced0b45e72'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.661608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc752d5e6b274018971e56ced0b45e72'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.662352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc752d5e6b274018971e56ced0b45e72'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.677879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] The token cache is being invalidate because project 060b1e503fd44fb886374ccb0134a58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:27.678372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.679561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-73d3dc74-bf6c-4e14-b295-b2a3465066c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.687198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 939/1899] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:27 2022] DELETE /identity/v3/projects/060b1e503fd44fb886374ccb0134a58e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:27.688266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 960/1899] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:27 2022] DELETE /identity/v3/users/dc752d5e6b274018971e56ced0b45e72 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:27.691675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.692652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.693242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.707604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.711846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.726137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:27.727635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.840034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 940/1900] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:27.841298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.846801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12287c-7870-4a7d-948c-a2ce91cf57fe admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:27.852164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.852311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:27.853136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.853487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.853831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] PATH_INFO: `/v3/users/628d1046dfc146858790da95a8ca917c` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.855703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=628d1046dfc146858790da95a8ca917c)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:27.858514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.869506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c9e98-548a-42b9-8f2e-fc26de8b3c65 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:27.876436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:27.877448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:27.877728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:27.877997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] PATH_INFO: `/v3/projects/60545c57e7f14c149711b80bd15855e5` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:27.879677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60545c57e7f14c149711b80bd15855e5)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:27.882745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:27.916004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628d1046dfc146858790da95a8ca917c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.926152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628d1046dfc146858790da95a8ca917c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.937940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628d1046dfc146858790da95a8ca917c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.939137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628d1046dfc146858790da95a8ca917c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.939785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628d1046dfc146858790da95a8ca917c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.954325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60545c57e7f14c149711b80bd15855e5', 'request_id': 'req-54ac5e1c-2f49-4216-8595-d0d46615a895'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.960392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 961/1901] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:27 2022] DELETE /identity/v3/users/628d1046dfc146858790da95a8ca917c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:27.963434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:27.963434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:27.966905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60545c57e7f14c149711b80bd15855e5', 'request_id': 'req-54ac5e1c-2f49-4216-8595-d0d46615a895'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.977886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60545c57e7f14c149711b80bd15855e5', 'request_id': 'req-54ac5e1c-2f49-4216-8595-d0d46615a895'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.997855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] The token cache is being invalidate because project 60545c57e7f14c149711b80bd15855e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:27.998221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:27.998952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-54ac5e1c-2f49-4216-8595-d0d46615a895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.000864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 941/1902] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:27 2022] DELETE /identity/v3/projects/60545c57e7f14c149711b80bd15855e5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:28.006883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661123ef-037a-4689-9a42-88dacfacc468 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.007304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661123ef-037a-4689-9a42-88dacfacc468 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.007682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661123ef-037a-4689-9a42-88dacfacc468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.033335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-661123ef-037a-4689-9a42-88dacfacc468 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:28.035032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-661123ef-037a-4689-9a42-88dacfacc468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.046743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38cc3-d757-4e11-8905-5e688a521fd1 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.050484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.051136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.051411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.051899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.053905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.107263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 942/1903] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:28.108971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.109276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.111047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.142988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.144808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.153094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:28.154825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.159479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 962/1904] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:28.175269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 943/1905] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:28.176964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.187378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28d20f-6a78-4c79-9154-91ecdcfd89e7 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.193924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.194888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.194997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.195425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.197009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:28.197009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.198595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.223369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 963/1906] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:28.225425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.239436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6decc3-8b97-41e1-a942-2e5bee170f6f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.246233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.246925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.247546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.247914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.248947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.252256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.293902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 944/1907] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:28.298700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.311913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b49d-1388-4577-9a62-56892d786278 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.388178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.391868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.392395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.392830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.393614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.395720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.428001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 964/1908] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:28.432462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.444453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.449964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9d5d-2174-4174-9027-3ed8e4435597 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.452333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.458247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.460993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.461732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.462475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.464212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.466785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.481556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 945/1909] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:28.485834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.491760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365d7a-ca94-4ac4-a896-a97f11b17452 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.503815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.503815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.503815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.503815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] PATH_INFO: `/v3/projects/5655af62f3b14549976caaea122f14d7` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.504496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c22e0-201a-43b7-8c70-a320e92e536c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.504974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5655af62f3b14549976caaea122f14d7)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.506868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.511527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.512461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.512873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.513299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.514155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.516058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.534153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 946/1910] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:28.535249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.552913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd6ff-75c3-4e02-9e5d-75ea6256eaf1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.559363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.560374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.560656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.560931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] PATH_INFO: `/v3/projects/b4a4b0ae3b5948808e8b6fa22299a86a/users/2d00238518854d4bbc9e3e1e068e7780/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.573844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5655af62f3b14549976caaea122f14d7', 'request_id': 'req-64452062-0440-4309-8d9e-2eb3d19c1959'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.592609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5655af62f3b14549976caaea122f14d7', 'request_id': 'req-64452062-0440-4309-8d9e-2eb3d19c1959'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.608391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5655af62f3b14549976caaea122f14d7', 'request_id': 'req-64452062-0440-4309-8d9e-2eb3d19c1959'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.613831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4b0ae3b5948808e8b6fa22299a86a, user_id=2d00238518854d4bbc9e3e1e068e7780, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.617070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f181d4-c548-4f29-aed3-f25a20fd7475 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.623287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] The token cache is being invalidate because project 5655af62f3b14549976caaea122f14d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:28.623613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.624358 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-64452062-0440-4309-8d9e-2eb3d19c1959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.629802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 965/1911] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:28 2022] DELETE /identity/v3/projects/5655af62f3b14549976caaea122f14d7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:28.631412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.631728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.632040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.637515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 947/1912] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:28 2022] PUT /identity/v3/projects/b4a4b0ae3b5948808e8b6fa22299a86a/users/2d00238518854d4bbc9e3e1e068e7780/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:28.652838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:28.654457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.655939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbaf7-58cd-46b4-ab77-81c7cc73365e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.657968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbaf7-58cd-46b4-ab77-81c7cc73365e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.658354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbaf7-58cd-46b4-ab77-81c7cc73365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.702960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-af4dbaf7-58cd-46b4-ab77-81c7cc73365e None None] MFA Rules not processed for user `2d00238518854d4bbc9e3e1e068e7780`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:28.704539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-af4dbaf7-58cd-46b4-ab77-81c7cc73365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.731882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 966/1913] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:28.733468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.734823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.751296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8191-c386-4e08-a4ef-fb88b45c8dfc None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.756671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.758255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.759026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.759586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] PATH_INFO: `/v3/projects/69c7c6b8f55f4595b3144c8abd512fa9` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.761382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c7c6b8f55f4595b3144c8abd512fa9)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.764195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.783321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 948/1914] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:28.785117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.785765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.785881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.818385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:28.819676 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.837302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c7c6b8f55f4595b3144c8abd512fa9', 'request_id': 'req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.844143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c7c6b8f55f4595b3144c8abd512fa9', 'request_id': 'req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.855375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c7c6b8f55f4595b3144c8abd512fa9', 'request_id': 'req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.868403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] The token cache is being invalidate because project 69c7c6b8f55f4595b3144c8abd512fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:28.868940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.870113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.876032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 967/1915] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:28 2022] DELETE /identity/v3/projects/69c7c6b8f55f4595b3144c8abd512fa9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:28.876919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.878923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.895719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 949/1916] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:28.896844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:28.898347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.914546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979db74f-5334-4550-a369-906fceb42fd1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.920566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.922262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.922677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.923047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] PATH_INFO: `/v3/users/961c55b5253b42bdb59511e7dcdb5050` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.925337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961c55b5253b42bdb59511e7dcdb5050)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:28.927481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:28.946734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ad24-4bd2-48d8-8b6f-4b6834f552bc admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:28.951066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:28.952003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:28.952467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:28.952960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:28.955491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:28.988066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961c55b5253b42bdb59511e7dcdb5050'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.988951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961c55b5253b42bdb59511e7dcdb5050'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:28.989639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961c55b5253b42bdb59511e7dcdb5050'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.009772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961c55b5253b42bdb59511e7dcdb5050'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.022058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961c55b5253b42bdb59511e7dcdb5050'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.037254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 950/1917] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:28 2022] DELETE /identity/v3/users/961c55b5253b42bdb59511e7dcdb5050 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:29.038383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.039726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.042218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.043827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.054472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 968/1918] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:29.115178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6e31-f832-4c68-a2e2-71a520c2dd83 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.122236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.122953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.123251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.123508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.124410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:29.124715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.126463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.150276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 951/1919] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:29.154758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.178496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc795a3-9f05-45e8-ad32-295c990de52e service glance] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.183637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.184458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.185311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.185311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.185912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.187843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.240744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 969/1920] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:29 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:29.244542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.256551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44e1bb-0250-47cd-8977-2fd629d0b842 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.345989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.348904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.349945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.351267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.354772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.356969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.394350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 952/1921] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:29 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:29.399105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.404375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.407194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.431151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2022a-7031-4b95-bd2c-d447701f7d84 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.437179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f27cf-3de1-4331-9bd8-98359ab1c5c1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.444140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.445236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.445845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.446523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.447353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.447492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.448279 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.448559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.448851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] PATH_INFO: `/v3/projects/019df79a24a44a23b6dc7dba8a5c2327` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.453831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.457008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=019df79a24a44a23b6dc7dba8a5c2327)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.459307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.481990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 970/1922] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:29.489103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.508212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6634e-fa73-4afd-b7e9-4361dcdc56a5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.522475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.523752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.544164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.544321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.545120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.546762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.550962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019df79a24a44a23b6dc7dba8a5c2327', 'request_id': 'req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.560910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019df79a24a44a23b6dc7dba8a5c2327', 'request_id': 'req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.565098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 971/1923] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:29.566466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.569613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.570520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019df79a24a44a23b6dc7dba8a5c2327', 'request_id': 'req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.595497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] The token cache is being invalidate because project 019df79a24a44a23b6dc7dba8a5c2327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:29.595985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.597860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85ba18-af52-4aa9-920a-d3a431dc9c70 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.599387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.601641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 953/1924] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:29 2022] DELETE /identity/v3/projects/019df79a24a44a23b6dc7dba8a5c2327 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:29.603073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:29.608512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.736556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5d00-6e30-4c45-a27d-f6e46906e7ad admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:29.746777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.747722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.748040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.749051 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] PATH_INFO: `/v3/users/335aa77488dd495298a36b4a6dbb7bb3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.750352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=335aa77488dd495298a36b4a6dbb7bb3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.752788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.753541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:29.756692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.759954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.760329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] PATH_INFO: `/v3/projects/c716defa4f564b66a86fadffeba3302a/users/7bf9df4b91bc40e6a0dd2b23b90f3e9f/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.800017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c716defa4f564b66a86fadffeba3302a, user_id=7bf9df4b91bc40e6a0dd2b23b90f3e9f, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:29.807579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aa865-a879-4bc6-92de-cd1b9f310c8f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:29.831500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 954/1925] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:29 2022] PUT /identity/v3/projects/c716defa4f564b66a86fadffeba3302a/users/7bf9df4b91bc40e6a0dd2b23b90f3e9f/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:29.842822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335aa77488dd495298a36b4a6dbb7bb3'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.843812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd258c42-9bc3-4a45-8750-1c03f3416275 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.844118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd258c42-9bc3-4a45-8750-1c03f3416275 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.844418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd258c42-9bc3-4a45-8750-1c03f3416275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.855329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335aa77488dd495298a36b4a6dbb7bb3'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.865025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335aa77488dd495298a36b4a6dbb7bb3'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.866119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335aa77488dd495298a36b4a6dbb7bb3'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.866756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-26bca430-dd96-4486-940e-5613cfd7a79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335aa77488dd495298a36b4a6dbb7bb3'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:29.875907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-fd258c42-9bc3-4a45-8750-1c03f3416275 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:29.878183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fd258c42-9bc3-4a45-8750-1c03f3416275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.888815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 972/1926] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:29 2022] DELETE /identity/v3/users/335aa77488dd495298a36b4a6dbb7bb3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:29.890975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0b01-cb6d-44d2-aecb-a598d283a027 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.891455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0b01-cb6d-44d2-aecb-a598d283a027 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.892675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0b01-cb6d-44d2-aecb-a598d283a027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.926781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e5fa0b01-cb6d-44d2-aecb-a598d283a027 None None] MFA Rules not processed for user `7bf9df4b91bc40e6a0dd2b23b90f3e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:29.928293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e5fa0b01-cb6d-44d2-aecb-a598d283a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:29.966949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 955/1927] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:29.969099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:29.969489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:29.969863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:29.989340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:29.990707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.005992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 973/1928] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:30.009223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.009688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.010092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.028350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:30.029672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.058172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 956/1929] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:30.061787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.061787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.081131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c002-2eca-4858-9cb6-3ada57af7de1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.086578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.087338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.088078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.088475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.089326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.091284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.109434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 974/1930] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:30.110572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.112413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.127817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 957/1931] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:30.129755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.188309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb41a-f587-4d19-8fc4-c1828d0e4b8a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.210869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f72ce-a975-4c7c-867b-57d342b03936 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.216989 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.217839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.218375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.218733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.219544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:30.219968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.221841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.237495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 958/1932] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:30.238411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.260094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11d3b-25f9-4b15-91c2-87d74fdbe306 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.260954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.261915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.262582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.263234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.276561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.277105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.277790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.278073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.278348 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.279044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.279849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.280994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.291243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 975/1933] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:30.292511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.302878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b31b-6aec-4f49-ac52-29cfb587c3f3 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.305555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 959/1934] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:30.309308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.310086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.310496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.310868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.311014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.312142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.314459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.322777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b35-5f42-4e6d-b0cf-e23970509feb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.336377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.338558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.338558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.338558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.340812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.346433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.359728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 976/1935] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:30.365446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.372021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 960/1936] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:30.377889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.392798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a1a-552c-4f14-8c2e-ac793cfbb321 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.455181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b781-7a82-425c-af9d-857c1846aa5c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.462179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.463287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.463571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.463889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.464584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.466726 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.484062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.484062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.484062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.484062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] PATH_INFO: `/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a/users/1a0080fe99654f9ea6739079709fdd24/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.502538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcb04c4d604383bfc0c8f115574b0a, user_id=1a0080fe99654f9ea6739079709fdd24, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.502862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 977/1937] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:30.505342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.506871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.530853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe186266-9b12-4143-be58-420c5a908e41 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.534890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 961/1938] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:30 2022] PUT /identity/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a/users/1a0080fe99654f9ea6739079709fdd24/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:30.536647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.607250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.608457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.609718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.613000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.613000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.613000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.627357 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 978/1939] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:30.630916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.632334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3535d-2245-4dde-836e-2ea088ef4af1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.637372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.638046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.638324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.638595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.639398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.641036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.641394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c984-9947-4e55-b224-80403ced7707 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.649159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.649964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.650319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.650695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.651760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.653454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.656126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 962/1940] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:30.659673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.667804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 979/1941] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:30.669494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.671811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e658b0-b19d-4fd6-80b9-f891cd0088e0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.677471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.678532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.679121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.679572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] PATH_INFO: `/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a/users/1a0080fe99654f9ea6739079709fdd24/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.682222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcb04c4d604383bfc0c8f115574b0a, user_id=1a0080fe99654f9ea6739079709fdd24, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.685393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae7041-30f8-4d91-abaf-efbad9596f25 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.686863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7b9d-8d2d-4b95-aacf-deb325bc965f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.692359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.693259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.693541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.693814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] PATH_INFO: `/v3/projects/d8aa37eb2ae34117b5c5aad6fcabe692/users/dd794019b9f440d0a488fbd12ee7b988/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.698405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 963/1942] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:30 2022] PUT /identity/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a/users/1a0080fe99654f9ea6739079709fdd24/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:30.709436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226783-5437-4975-a65f-08b1f982042b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.709436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226783-5437-4975-a65f-08b1f982042b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.709695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226783-5437-4975-a65f-08b1f982042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.714215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8aa37eb2ae34117b5c5aad6fcabe692, user_id=dd794019b9f440d0a488fbd12ee7b988, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.717807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad682f-ce21-4c52-af98-35169dcc764d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.735486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 980/1943] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:30 2022] PUT /identity/v3/projects/d8aa37eb2ae34117b5c5aad6fcabe692/users/dd794019b9f440d0a488fbd12ee7b988/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:30.745864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.746268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.746604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.748626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6f226783-5437-4975-a65f-08b1f982042b None None] MFA Rules not processed for user `1a0080fe99654f9ea6739079709fdd24`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:30.749951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6f226783-5437-4975-a65f-08b1f982042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.780023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] MFA Rules not processed for user `dd794019b9f440d0a488fbd12ee7b988`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:30.781672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.832152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 964/1944] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:30.844495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226783-5437-4975-a65f-08b1f982042b None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.846123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6f226783-5437-4975-a65f-08b1f982042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:30.874423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 981/1945] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:30.875501 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:30.938635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226783-5437-4975-a65f-08b1f982042b None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.946671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.948062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.948594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.949092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.974656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.976391 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:30.984586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae910-29ca-4495-b757-eb424b63cb08 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:30.991263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:30.992015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:30.992324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:30.992630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:30.993333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:30.995398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.003347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 965/1946] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:31.027832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 982/1947] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:30 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:31.031742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.050993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e80fb-4192-49e5-b260-94d730036514 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.094312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.141681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.142807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.143234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.144412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.146087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.149500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.184156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 966/1948] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:31 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:31.185246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.187202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f2f0-7a8d-4a44-a590-d31b43758896 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.187481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:31.191720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.192856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.193304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.193722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.211986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7396-6ea2-41dd-88a4-36822572ba86 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.225434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.226929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.227313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.227875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] PATH_INFO: `/v3/projects/5522599390ce4661ba7e83c19c9c025a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.243222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5522599390ce4661ba7e83c19c9c025a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.245244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.304583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.306628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.339587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 983/1949] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:31.340125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.363372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5522599390ce4661ba7e83c19c9c025a', 'request_id': 'req-a45a5b39-c064-4006-808b-768503b9942c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.377454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5522599390ce4661ba7e83c19c9c025a', 'request_id': 'req-a45a5b39-c064-4006-808b-768503b9942c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.383684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5522599390ce4661ba7e83c19c9c025a', 'request_id': 'req-a45a5b39-c064-4006-808b-768503b9942c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.387968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59798f-5108-42bf-9ed5-54756afc4148 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.405994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] The token cache is being invalidate because project 5522599390ce4661ba7e83c19c9c025a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:31.406283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.412247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.414336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 967/1950] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:31 2022] DELETE /identity/v3/projects/5522599390ce4661ba7e83c19c9c025a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:31.418097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.419576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:31.551218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.554011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.554346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.554633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.555377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.555685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b39-c064-4006-808b-768503b9942c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.557254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.560444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.561729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.561729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.561947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] PATH_INFO: `/v3/users/0c2aa1c6b4294093a04bd62c5ad49fd8` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.563141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2aa1c6b4294093a04bd62c5ad49fd8)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.565106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.578835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 984/1951] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:31.580529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.583238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:31.620858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663225f-6dca-4533-be6c-5b2475935c4e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.628184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2aa1c6b4294093a04bd62c5ad49fd8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.629272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2aa1c6b4294093a04bd62c5ad49fd8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.630027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2aa1c6b4294093a04bd62c5ad49fd8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.632621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.634361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.634361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.634361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] PATH_INFO: `/v3/projects/d98d2e08754f4772a6a26de2ab2962b2/users/130f87dc950344c193ba1096aabab45a/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.650263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2aa1c6b4294093a04bd62c5ad49fd8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.661598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2aa1c6b4294093a04bd62c5ad49fd8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:31.673386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98d2e08754f4772a6a26de2ab2962b2, user_id=130f87dc950344c193ba1096aabab45a, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.676520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.680359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 968/1952] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:31 2022] DELETE /identity/v3/users/0c2aa1c6b4294093a04bd62c5ad49fd8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:31.701359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 985/1953] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:31 2022] PUT /identity/v3/projects/d98d2e08754f4772a6a26de2ab2962b2/users/130f87dc950344c193ba1096aabab45a/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:31.704172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.715108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:31.833018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270840-9f9f-4c65-9aeb-94d6c43f2713 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.931397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.932130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.932525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.932888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.933699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.935430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c285ee5-596c-4a9f-8f26-2eaa36c31d91 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:31.950990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 969/1954] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:31.955241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:31.973409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd29ec-4ba1-4051-9154-72fe695bf05e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:31.983666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:31.984702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:31.985070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:31.985433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] PATH_INFO: `/v3/projects/d98d2e08754f4772a6a26de2ab2962b2/users/130f87dc950344c193ba1096aabab45a/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:31.987585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98d2e08754f4772a6a26de2ab2962b2, user_id=130f87dc950344c193ba1096aabab45a, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:31.990609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.011990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 986/1955] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:31 2022] PUT /identity/v3/projects/d98d2e08754f4772a6a26de2ab2962b2/users/130f87dc950344c193ba1096aabab45a/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:32.015299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.015592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.015900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.050578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.054915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.086612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] MFA Rules not processed for user `130f87dc950344c193ba1096aabab45a`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:32.090769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.180613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 970/1956] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:32.189812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989c439-faca-461c-b1ae-61ec93cba166 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.192972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.194764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.195449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.196708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.199270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.199648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] PATH_INFO: `/v3/projects/5a93d6e8977248579dc1e0dade6c3125` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.201092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a93d6e8977248579dc1e0dade6c3125)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.203089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.262758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89b52f-2ddb-4fee-ab78-0b95bae5d655 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.276912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a93d6e8977248579dc1e0dade6c3125', 'request_id': 'req-4d697614-5b14-4fb2-ad7c-778f8212b65f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:32.282992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a93d6e8977248579dc1e0dade6c3125', 'request_id': 'req-4d697614-5b14-4fb2-ad7c-778f8212b65f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:32.293298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a93d6e8977248579dc1e0dade6c3125', 'request_id': 'req-4d697614-5b14-4fb2-ad7c-778f8212b65f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:32.310472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] The token cache is being invalidate because project 5a93d6e8977248579dc1e0dade6c3125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:32.310967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:32.311691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4d697614-5b14-4fb2-ad7c-778f8212b65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:32.313788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 987/1957] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:32 2022] DELETE /identity/v3/projects/5a93d6e8977248579dc1e0dade6c3125 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:32.318470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.318824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.319338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.321926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.322592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.322874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.323223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.324986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.344229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:32.345592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.390096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.391730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767400-7167-4e86-8731-ad7b60e2c98b service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.403907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 971/1958] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:32.419244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 988/1959] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:32.426742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.427029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.428295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.449862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:32.451070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:32.460370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 972/1960] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:32.464716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.475564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ef60-d308-4900-97c5-a91e2f162b9f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.480975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.481709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.482067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.482391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.483178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:32.483542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.485237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.497409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 989/1961] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:32.502077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.514651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657faa8a-e2aa-4a9a-ad37-d7f28f6a32c0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.519796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.520529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.521249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.521249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.521811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.524939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.563949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 973/1962] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:32.565336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.578089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82428-aae1-413f-9570-b354c02f50d3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.651640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.652844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.653231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.653605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.654635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.657003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.702492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 990/1963] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:32.703172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.717224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8bb6-2c93-426f-af36-06ad22aecca4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.734992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.735963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.736245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.736525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.737257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.745119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.764025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 974/1964] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:32.764165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.774310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e5dda-46d4-49e2-ac80-5536f86d0720 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.781303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.782146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.782436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.782894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.783800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.785964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150349-d2df-4d78-9db6-d73bfe1fcecd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.811449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 991/1965] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:32.812542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:32.823132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071702a0-edf7-4a2d-8391-999d31e017e5 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:32.831218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:32.832208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.832487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.832757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] PATH_INFO: `/v3/projects/c99c0bbb3d4f4595b02a9bfd083e6149/users/b2f414c768f34730839c5f563d602ae8/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.850806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99c0bbb3d4f4595b02a9bfd083e6149, user_id=b2f414c768f34730839c5f563d602ae8, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:32.855086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:32.871202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 975/1966] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:32 2022] PUT /identity/v3/projects/c99c0bbb3d4f4595b02a9bfd083e6149/users/b2f414c768f34730839c5f563d602ae8/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:32.883465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:32.884012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:32.884538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:32.920725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] MFA Rules not processed for user `b2f414c768f34730839c5f563d602ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:32.924384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:33.039064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 992/1967] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:33.039802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.139370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a124-d532-4e6f-ab82-c1acc88b6d05 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.155629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.158099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.158099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.158099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.158099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.159972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.219215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 976/1968] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:33 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:33.224066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.244864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014dca4-1762-42ae-a363-540de649e3fa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.347676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.348465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.348822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.349134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.349841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.351886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.375547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 993/1969] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:33 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:33.379499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.389736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9b18-72eb-4ed2-87ce-2df548ae21e9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.394536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.395223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.395513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.395809 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.396546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.398311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.412128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 977/1970] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:33.414817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.428531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431001-d0b8-4726-97eb-7c0d6c81eb6a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.433265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.434179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.434453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.434730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] PATH_INFO: `/v3/projects/794c485837094dcfa5a0c06121b680dc/users/f2b308cfd8fd4c2ea038cd4910382c00/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.451616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=794c485837094dcfa5a0c06121b680dc, user_id=f2b308cfd8fd4c2ea038cd4910382c00, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.454845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.470776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 994/1971] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:33 2022] PUT /identity/v3/projects/794c485837094dcfa5a0c06121b680dc/users/f2b308cfd8fd4c2ea038cd4910382c00/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:33.474766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.485735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51d2b4-f43e-43c0-8171-59ab59d26b27 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.551102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.551915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.552198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.552492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.553269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.554962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87085bfc-8942-4561-8b7c-b83ddffd7c40 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.565138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 978/1972] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:33.569324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.579399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ce8df-9b08-49fe-895f-853b642a520b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.583920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.584796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.585075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.585348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] PATH_INFO: `/v3/projects/794c485837094dcfa5a0c06121b680dc/users/f2b308cfd8fd4c2ea038cd4910382c00/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.587654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=794c485837094dcfa5a0c06121b680dc, user_id=f2b308cfd8fd4c2ea038cd4910382c00, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.591024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.601811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 995/1973] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:33 2022] PUT /identity/v3/projects/794c485837094dcfa5a0c06121b680dc/users/f2b308cfd8fd4c2ea038cd4910382c00/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:33.613288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.613716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.614148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.649404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] MFA Rules not processed for user `f2b308cfd8fd4c2ea038cd4910382c00`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:33.651276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:33.743089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 979/1974] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:33.755569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.757880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:33.827129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd6bdf-bc30-446b-8f79-f312d231b6fb admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.831048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.831798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.832082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.832356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.841580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.843079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5970f-7d57-42ba-96f7-157a0f106192 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:33.857005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 996/1975] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:33.884315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:33.947313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310f4e-6dbb-4ee7-880b-774cae394821 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:33.952089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:33.952978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:33.953256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:33.953533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] PATH_INFO: `/v3/users/b2f414c768f34730839c5f563d602ae8` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:33.954725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f414c768f34730839c5f563d602ae8)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:33.956699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:34.009766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f414c768f34730839c5f563d602ae8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.010480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f414c768f34730839c5f563d602ae8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.011121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f414c768f34730839c5f563d602ae8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.023030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f414c768f34730839c5f563d602ae8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.031366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f414c768f34730839c5f563d602ae8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.043369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 980/1976] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:33 2022] DELETE /identity/v3/users/b2f414c768f34730839c5f563d602ae8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:34.049087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:34.049588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:34.049685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:34.068160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:34.069631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:34.151282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 997/1977] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:34.160904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:34.162691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:34.243629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa306-f803-4361-8f28-93ef41108e80 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:34.247633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:34.248416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:34.248758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:34.249200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:34.258593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:34.260274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:34.291025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 981/1978] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:34.728833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:34.730847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:34.743246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758cf38-3646-4093-9afb-4ef7f7852ab4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:34.749179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:34.750213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:34.750516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:34.750854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] PATH_INFO: `/v3/projects/c99c0bbb3d4f4595b02a9bfd083e6149` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:34.754233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99c0bbb3d4f4595b02a9bfd083e6149)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:34.756204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:34.806443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99c0bbb3d4f4595b02a9bfd083e6149', 'request_id': 'req-bec9543c-25bf-4f56-9a83-ed0068f68521'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.812024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99c0bbb3d4f4595b02a9bfd083e6149', 'request_id': 'req-bec9543c-25bf-4f56-9a83-ed0068f68521'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.821058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99c0bbb3d4f4595b02a9bfd083e6149', 'request_id': 'req-bec9543c-25bf-4f56-9a83-ed0068f68521'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.831646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] The token cache is being invalidate because project c99c0bbb3d4f4595b02a9bfd083e6149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:34.831935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.832552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.834093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 998/1979] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:34 2022] DELETE /identity/v3/projects/c99c0bbb3d4f4595b02a9bfd083e6149 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:34.838609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:34.848325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829d4ad-971a-4646-aed6-b6501e8c06c3 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:34.907356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:34.908268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:34.908545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:34.908819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] PATH_INFO: `/v3/users/f2b308cfd8fd4c2ea038cd4910382c00` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:34.910029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b308cfd8fd4c2ea038cd4910382c00)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:34.912008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:34.960146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b308cfd8fd4c2ea038cd4910382c00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.960821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b308cfd8fd4c2ea038cd4910382c00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.961427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b308cfd8fd4c2ea038cd4910382c00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.973107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b308cfd8fd4c2ea038cd4910382c00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.982010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3c6bbb9d-3b10-430c-a7fe-f6b0211acd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b308cfd8fd4c2ea038cd4910382c00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:34.994953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 982/1980] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:34 2022] DELETE /identity/v3/users/f2b308cfd8fd4c2ea038cd4910382c00 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:35.053985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.055601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.068714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9543c-25bf-4f56-9a83-ed0068f68521 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.155640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.156640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.156921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.157722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] PATH_INFO: `/v3/users/dd794019b9f440d0a488fbd12ee7b988` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.158680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd794019b9f440d0a488fbd12ee7b988)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.160673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.240855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd794019b9f440d0a488fbd12ee7b988'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.249675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd794019b9f440d0a488fbd12ee7b988'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.258547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd794019b9f440d0a488fbd12ee7b988'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.259311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd794019b9f440d0a488fbd12ee7b988'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.259936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd794019b9f440d0a488fbd12ee7b988'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.279885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 999/1981] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:35 2022] DELETE /identity/v3/users/dd794019b9f440d0a488fbd12ee7b988 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:35.282291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.282610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.282887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.309788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.311290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.311424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:35.312624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.377547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 983/1982] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:35.378302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e0d2-b63b-47a9-a126-1e5def6acc4d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.383032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.383933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.384213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.384486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] PATH_INFO: `/v3/projects/794c485837094dcfa5a0c06121b680dc` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.385699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=794c485837094dcfa5a0c06121b680dc)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.387266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.387931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.389019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.436166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794c485837094dcfa5a0c06121b680dc', 'request_id': 'req-61bf4c91-cd1c-4448-abe9-809c064eeddf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.443394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794c485837094dcfa5a0c06121b680dc', 'request_id': 'req-61bf4c91-cd1c-4448-abe9-809c064eeddf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.445742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fa7c-c153-45cc-a4b4-41bcd29079db None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.452416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794c485837094dcfa5a0c06121b680dc', 'request_id': 'req-61bf4c91-cd1c-4448-abe9-809c064eeddf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.466972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] The token cache is being invalidate because project 794c485837094dcfa5a0c06121b680dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:35.467228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.468020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-61bf4c91-cd1c-4448-abe9-809c064eeddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:35.469662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1000/1983] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:35 2022] DELETE /identity/v3/projects/794c485837094dcfa5a0c06121b680dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:35.476269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b99d2-9423-4626-8f90-022276245b80 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.476709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b99d2-9423-4626-8f90-022276245b80 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.476976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b99d2-9423-4626-8f90-022276245b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.497269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-787b99d2-9423-4626-8f90-022276245b80 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:35.498463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-787b99d2-9423-4626-8f90-022276245b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.499523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.500196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.500552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.500740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.502478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.556335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1001/1984] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:35.563995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.564165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.564303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.564661 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.565791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.576232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 984/1985] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:35.588226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:35.589451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.598980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1002/1986] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:35.603359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.617309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c6ce-747a-491c-ad48-c4ad976fdd50 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.622324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.623062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.623268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.623719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.624477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:35.625179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.627615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.639023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 985/1987] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:35.643257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.655336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fd65d-ae47-48d7-b14d-8a5df7e65a32 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.664335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.665171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.665456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.665732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.666449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.668582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.705434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1003/1988] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:35.709866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.726631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58244cf-c9a4-45d9-a8fa-a5052e09a15e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.811695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.812448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.812739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.813012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.813728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.815967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.839797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 986/1989] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:35.843897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.854940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09131-4108-491c-bab4-1acfb8485c83 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.859998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.860458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.860740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.861015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.861740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.863402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.875254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1004/1990] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:35.879465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.890831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa154d-0a8e-4f3e-af56-fe41d84849d0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.896028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.898929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:35.902416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.903284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.903732 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.904195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.905083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.907090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.913720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494e8ae-1766-4e50-a152-087725846237 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.919935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.921046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.921538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.922301 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] PATH_INFO: `/v3/projects/d8aa37eb2ae34117b5c5aad6fcabe692` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.923373 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 987/1991] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:35.924722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:35.937901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8aa37eb2ae34117b5c5aad6fcabe692)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.938654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453cb5f-f201-4e0d-9312-148a07c3caa2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:35.939335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.945149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:35.946639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.947304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.947719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] PATH_INFO: `/v3/projects/7d60efd6043440e090b89dabd5e017a0/users/24289597d01a4a0388e9ce384af913d7/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.965114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d60efd6043440e090b89dabd5e017a0, user_id=24289597d01a4a0388e9ce384af913d7, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:35.967841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6739e9-0a37-4342-b9f0-e4111d354bec admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:35.983332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 988/1992] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:35 2022] PUT /identity/v3/projects/7d60efd6043440e090b89dabd5e017a0/users/24289597d01a4a0388e9ce384af913d7/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:35.993907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:35.994280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:35.994636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:35.995995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8aa37eb2ae34117b5c5aad6fcabe692', 'request_id': 'req-9ed0adff-c298-45e5-a92d-61002b9a917b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.003284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8aa37eb2ae34117b5c5aad6fcabe692', 'request_id': 'req-9ed0adff-c298-45e5-a92d-61002b9a917b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.011008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8aa37eb2ae34117b5c5aad6fcabe692', 'request_id': 'req-9ed0adff-c298-45e5-a92d-61002b9a917b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.021968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] MFA Rules not processed for user `24289597d01a4a0388e9ce384af913d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:36.022962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] The token cache is being invalidate because project d8aa37eb2ae34117b5c5aad6fcabe692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:36.023176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.023397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.024327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.027820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1005/1993] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:35 2022] DELETE /identity/v3/projects/d8aa37eb2ae34117b5c5aad6fcabe692 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:36.030285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.032450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.090567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 989/1994] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:36.097270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.098433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.106261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0adff-c298-45e5-a92d-61002b9a917b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.111553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.112480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.112916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.113195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] PATH_INFO: `/v3/users/130f87dc950344c193ba1096aabab45a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.114515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130f87dc950344c193ba1096aabab45a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.116660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.116943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcb7b1-901e-4bad-a670-09c04e252875 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.125440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.126344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.126726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.127036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.127687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.129713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.160523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 990/1995] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:36.164745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.170430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130f87dc950344c193ba1096aabab45a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.180073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130f87dc950344c193ba1096aabab45a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.187420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130f87dc950344c193ba1096aabab45a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.188157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130f87dc950344c193ba1096aabab45a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.188858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130f87dc950344c193ba1096aabab45a'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.215810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1006/1996] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:36 2022] DELETE /identity/v3/users/130f87dc950344c193ba1096aabab45a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:36.236836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0a1c-0f09-49a7-9dda-916596122197 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.297206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.298057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.298514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.298886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.299702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.301867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.328244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 991/1997] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:36.329191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.330799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.347843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c3be-791c-4b6f-8b29-a09dd2521645 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.354828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.355604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.355992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.356334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.357202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.358889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.369980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1007/1998] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:36.374189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.385374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411dd0-db53-4cb3-847a-ac585699d6dd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.403046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.404019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.404300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.404579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] PATH_INFO: `/v3/projects/96d851ff65454580b1dfd3133ac32510/users/1fff4b948d9b41b6b07a8e15ce3a1bd0/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.423684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d851ff65454580b1dfd3133ac32510, user_id=1fff4b948d9b41b6b07a8e15ce3a1bd0, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.426361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.443342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 992/1999] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:36 2022] PUT /identity/v3/projects/96d851ff65454580b1dfd3133ac32510/users/1fff4b948d9b41b6b07a8e15ce3a1bd0/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:36.448497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.460623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722516dd-ee17-412a-bc7f-290323a3a5cb admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.525388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.527249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.529770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.531349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.531641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.531992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.533062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.534758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.541393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b2bb-8fe9-42f4-be06-d3fe3034f755 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.548779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1008/2000] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:36.550314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.551175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.552162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.552503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.552782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] PATH_INFO: `/v3/projects/d98d2e08754f4772a6a26de2ab2962b2` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.554043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98d2e08754f4772a6a26de2ab2962b2)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.556051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.563048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a937-d86e-423f-a875-ad4c4013f0c0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.567899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.568776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.569124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.569396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] PATH_INFO: `/v3/projects/96d851ff65454580b1dfd3133ac32510/users/1fff4b948d9b41b6b07a8e15ce3a1bd0/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.571415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d851ff65454580b1dfd3133ac32510, user_id=1fff4b948d9b41b6b07a8e15ce3a1bd0, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.574082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13e144-e2c5-4d6a-ae4e-f57262917243 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.585505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1009/2001] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:36 2022] PUT /identity/v3/projects/96d851ff65454580b1dfd3133ac32510/users/1fff4b948d9b41b6b07a8e15ce3a1bd0/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:36.597003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.597291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.597595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.602371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98d2e08754f4772a6a26de2ab2962b2', 'request_id': 'req-4b47def9-5d54-49aa-9f62-40c8ad6b71be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.612710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98d2e08754f4772a6a26de2ab2962b2', 'request_id': 'req-4b47def9-5d54-49aa-9f62-40c8ad6b71be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.618413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98d2e08754f4772a6a26de2ab2962b2', 'request_id': 'req-4b47def9-5d54-49aa-9f62-40c8ad6b71be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.628210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] MFA Rules not processed for user `1fff4b948d9b41b6b07a8e15ce3a1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:36.629385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.629602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] The token cache is being invalidate because project d98d2e08754f4772a6a26de2ab2962b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:36.629890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.630547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4b47def9-5d54-49aa-9f62-40c8ad6b71be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:36.632437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 993/2002] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:36 2022] DELETE /identity/v3/projects/d98d2e08754f4772a6a26de2ab2962b2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:36.637061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538ff7-0537-409d-8032-43ad6497e289 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.637351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538ff7-0537-409d-8032-43ad6497e289 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.637657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538ff7-0537-409d-8032-43ad6497e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.662733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-05538ff7-0537-409d-8032-43ad6497e289 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:36.664266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-05538ff7-0537-409d-8032-43ad6497e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.708929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1010/2003] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:36.720489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.721869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.730934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 994/2004] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:36.739520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.739830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.740104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.758374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:36.759581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.767877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 995/2005] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:36.772071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.782765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b0271-8c4a-4288-8252-9c5934e82d4d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.783048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bce9c-1067-4869-ac96-8b814ec024d9 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.787545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.788375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.788641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.788832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.789194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.789341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.789619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.789892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.790685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:36.791016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.792728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.799524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.801365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.809457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 996/2006] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:36.810466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.815231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1011/2007] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:36.820201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10e85b-6cd6-49e8-ba4c-3022cd193052 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.825152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.825864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.826206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.826550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.827336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.829338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.864056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 997/2008] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:36.864652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.877460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc99c-8488-4c1d-98cd-3c2af10f7071 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.889577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.892128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:36.935732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.936449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.936727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.937001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.937701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.940506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.962315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1012/2009] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:36 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:36.964938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b4e-b5a8-475e-be7e-cdbd9c2c8926 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.966283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:36.969818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.970703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.970981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.971254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] PATH_INFO: `/v3/users/24289597d01a4a0388e9ce384af913d7` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.972715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=24289597d01a4a0388e9ce384af913d7)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.974897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:36.978617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53118-35d4-491c-a474-ae24dab2d33c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:36.988806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:36.989488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:36.989764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:36.990038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:36.991282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:36.994465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.008978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1013/2010] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:37.013627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.025811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d038a-f17e-4db2-b416-11c6d187e878 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.035063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.035755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.036270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.036517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.036943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24289597d01a4a0388e9ce384af913d7'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.037250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.038100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24289597d01a4a0388e9ce384af913d7'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.038934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.041616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24289597d01a4a0388e9ce384af913d7'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.050556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1014/2011] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:37.054857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.055113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24289597d01a4a0388e9ce384af913d7'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.056608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.064883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b095d0a6-d583-48a6-bd1a-a4c96ec78ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24289597d01a4a0388e9ce384af913d7'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.070698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cb06-35c9-43c1-8311-ec6d73583b4e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.078740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.080349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 998/2012] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:36 2022] DELETE /identity/v3/users/24289597d01a4a0388e9ce384af913d7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:37.080774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.081066 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.081344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] PATH_INFO: `/v3/projects/8b00567be54b4ee598c70999a0c96551/users/04cd58b2eaa94987b8176577c2673013/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.085736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.086233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.086813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.097486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b00567be54b4ee598c70999a0c96551, user_id=04cd58b2eaa94987b8176577c2673013, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.100274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563405ac-f3ac-44ae-8925-2f90668715a0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.109263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:37.111122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.121888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1015/2013] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:37 2022] PUT /identity/v3/projects/8b00567be54b4ee598c70999a0c96551/users/04cd58b2eaa94987b8176577c2673013/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:37.132624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.133018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.133522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.165186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] MFA Rules not processed for user `04cd58b2eaa94987b8176577c2673013`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:37.166547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.179837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 999/2014] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:37.196977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.198359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.249885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1016/2015] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:37.261027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c5ae8-b330-4277-b89f-a900a7636dd5 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.261506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.263054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.265187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.265904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.266388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.266671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.276904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.278546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.288996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1000/2016] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:37.326856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28dc1-cdf4-4aef-8c42-419cb1450ca5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.330824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.331584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.331889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.332174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.342970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.344161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.353052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1017/2017] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:54:37.571110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.572643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:37.591423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6340a-8ff4-4d2e-8207-b5c8137949ff service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.597988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.598868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.599154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.599427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] PATH_INFO: `/v3/projects/7d60efd6043440e090b89dabd5e017a0` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.600898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d60efd6043440e090b89dabd5e017a0)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.602825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.678834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d60efd6043440e090b89dabd5e017a0', 'request_id': 'req-23736e6f-fdd7-43a1-acec-185256d6b5be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.687006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d60efd6043440e090b89dabd5e017a0', 'request_id': 'req-23736e6f-fdd7-43a1-acec-185256d6b5be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.694195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d60efd6043440e090b89dabd5e017a0', 'request_id': 'req-23736e6f-fdd7-43a1-acec-185256d6b5be'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.708378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] The token cache is being invalidate because project 7d60efd6043440e090b89dabd5e017a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:37.708645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.709469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.711080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1001/2018] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:37 2022] DELETE /identity/v3/projects/7d60efd6043440e090b89dabd5e017a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:37.717437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:37.728500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e8d5-be6c-4558-b95e-3669be77106d service glance] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:37.796458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:37.797339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:37.797772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:37.798185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] PATH_INFO: `/v3/users/1fff4b948d9b41b6b07a8e15ce3a1bd0` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:37.799921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fff4b948d9b41b6b07a8e15ce3a1bd0)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:37.802408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:37.855462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fff4b948d9b41b6b07a8e15ce3a1bd0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.862899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fff4b948d9b41b6b07a8e15ce3a1bd0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.871331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fff4b948d9b41b6b07a8e15ce3a1bd0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.872364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fff4b948d9b41b6b07a8e15ce3a1bd0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.873016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5ca259e3-13b2-4c9f-8a5a-f0ac0423149d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fff4b948d9b41b6b07a8e15ce3a1bd0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:37.891292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1018/2019] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:37 2022] DELETE /identity/v3/users/1fff4b948d9b41b6b07a8e15ce3a1bd0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:38.168135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.169993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:38.184949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736e6f-fdd7-43a1-acec-185256d6b5be admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.301387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.302564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.302902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.303456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] PATH_INFO: `/v3/projects/96d851ff65454580b1dfd3133ac32510` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.304950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d851ff65454580b1dfd3133ac32510)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.307061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.370555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d851ff65454580b1dfd3133ac32510', 'request_id': 'req-3caac333-90f9-4ee3-b982-73f413939a9f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:38.381830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d851ff65454580b1dfd3133ac32510', 'request_id': 'req-3caac333-90f9-4ee3-b982-73f413939a9f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:38.387702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d851ff65454580b1dfd3133ac32510', 'request_id': 'req-3caac333-90f9-4ee3-b982-73f413939a9f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:38.400122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] The token cache is being invalidate because project 96d851ff65454580b1dfd3133ac32510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:38.400408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:38.401085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3caac333-90f9-4ee3-b982-73f413939a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:38.402942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1002/2020] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:38 2022] DELETE /identity/v3/projects/96d851ff65454580b1dfd3133ac32510 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:38.407797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.408276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.408579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.427081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:38.428382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:38.492625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1019/2021] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:38.500499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.500959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.501372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.529607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:38.531033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:38.539815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1003/2022] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:38.544070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.553552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6528111-fab9-4272-8b99-514b0c88cca3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.558154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.558800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.559075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.559343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.560082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:38.560381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.561954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.576152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1020/2023] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:38.580475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.592233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c720bc-7868-4b64-ad16-30e9e2cfd6ff None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.598257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.599364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.599887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.600432 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.601572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.604652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.636796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1004/2024] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:38 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:38.637989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.648093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a364-dd2d-4b06-a7cc-54e04a17d1d9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.706699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.707509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.707900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.708242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.709015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.711233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.744685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1021/2025] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:38 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:38.745428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.761526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9a4b-1dec-43ef-87f2-0badce12a3cd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.771351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.772142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.772431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.772970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.773711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.780000 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.793583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1005/2026] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:38.797569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.812546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdef-1490-4682-9376-3fa40920e841 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.818535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.819366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.819711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.820021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.820749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.822546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd0e5-bee0-463b-8a52-9b3068c68c71 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.838590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1022/2027] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:38.840687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:38.850726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7274f9-c44f-497b-8d46-429df3feb572 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:38.857936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:38.858829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.859105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.859564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] PATH_INFO: `/v3/projects/12e2ea126e9b4ddd8b3b736361e30bf3/users/543a71e36bc944e19318ce2ed4e74d8e/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.878199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e2ea126e9b4ddd8b3b736361e30bf3, user_id=543a71e36bc944e19318ce2ed4e74d8e, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:38.881571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:38.903811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1006/2028] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:38 2022] PUT /identity/v3/projects/12e2ea126e9b4ddd8b3b736361e30bf3/users/543a71e36bc944e19318ce2ed4e74d8e/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:38.912872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:38.913861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:38.914151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:38.952637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] MFA Rules not processed for user `543a71e36bc944e19318ce2ed4e74d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:38.954046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:39.037491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1023/2029] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:39.042137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.113890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895915-06d7-494a-8e72-b38aa82905d2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.118904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.119715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.120111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.120471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.121252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.123210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.156357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1007/2030] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:39 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:39.161880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.174080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08288-df82-4561-997c-b5f53240fab0 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.236603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.237317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.237603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.238096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.238819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.240879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.279168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1024/2031] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:39 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:39.285354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.302963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cdbc-8c04-4cef-9d44-bed622eaa8c6 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.311054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.312212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.312665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.313191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.314446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.317441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.340447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1008/2032] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:39.344990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.355994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276913f6-fa7e-49a7-9758-80e05f367ee9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.361096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.362078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.362454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.362736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] PATH_INFO: `/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad/users/7e0a2c644f6944b0964fa87737afa4ff/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.379128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7b20b6eee460ea6c5fa9606253cad, user_id=7e0a2c644f6944b0964fa87737afa4ff, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.382109 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.404837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1025/2033] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:39 2022] PUT /identity/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad/users/7e0a2c644f6944b0964fa87737afa4ff/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:39.409561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.420756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a00c6-191b-4c61-b995-04d342a60bdd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.482364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.483065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.483338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.483604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.484357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.485955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e375-6d16-4412-b243-c8f4487a9760 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.497093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1009/2034] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:39.501487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.512549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d964-19d9-4e3c-bf70-54cee3120dff admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.518306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.519222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.519502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.519807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] PATH_INFO: `/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad/users/7e0a2c644f6944b0964fa87737afa4ff/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.522391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7b20b6eee460ea6c5fa9606253cad, user_id=7e0a2c644f6944b0964fa87737afa4ff, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.525001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.540904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1026/2035] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:39 2022] PUT /identity/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad/users/7e0a2c644f6944b0964fa87737afa4ff/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:39.552920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.553265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.553556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.588991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] MFA Rules not processed for user `7e0a2c644f6944b0964fa87737afa4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:39.589441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:39.668668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1010/2036] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:39.684708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.687981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:39.754788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9360-01cf-4d3f-87a6-957b43a3ade4 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.758435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.759118 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.759394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.759682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.769891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.771336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.781303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1027/2037] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:39.830028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:39.831560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:39.846254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304e8d7-4979-45e7-9010-a5a9c6998ea7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:39.850318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:39.850969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:39.851258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:39.851520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:39.911757 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:39.914235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6776a-7446-48ca-994c-ff7844631c2c service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:39.926770 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1011/2038] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:41.869462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:41.870874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:41.944284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca699-3a75-4493-9cec-cd6cfa621657 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:41.951245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:41.952189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:41.952471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:41.952742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] PATH_INFO: `/v3/users/7bf9df4b91bc40e6a0dd2b23b90f3e9f` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:41.953932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf9df4b91bc40e6a0dd2b23b90f3e9f)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:41.956870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:42.012736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf9df4b91bc40e6a0dd2b23b90f3e9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.020791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf9df4b91bc40e6a0dd2b23b90f3e9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.028974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf9df4b91bc40e6a0dd2b23b90f3e9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.029784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf9df4b91bc40e6a0dd2b23b90f3e9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.030553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf9df4b91bc40e6a0dd2b23b90f3e9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.061518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1028/2039] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:41 2022] DELETE /identity/v3/users/7bf9df4b91bc40e6a0dd2b23b90f3e9f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:42.068031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:42.068031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:42.068031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:42.086304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:42.087500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:42.171387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1012/2040] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:42.182189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:42.184017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:42.296264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63db4-4429-4887-8c66-b354b2c8e415 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:42.299863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:42.300517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:42.300793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:42.301063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:42.311039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:42.312808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:42.323688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1029/2041] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:42.668461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:42.670284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:42.686291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294021d-54aa-40d2-be37-c14313a00318 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:42.691165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:42.692202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:42.692534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:42.692885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] PATH_INFO: `/v3/projects/c716defa4f564b66a86fadffeba3302a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:42.695158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c716defa4f564b66a86fadffeba3302a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:42.698197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:42.754654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c716defa4f564b66a86fadffeba3302a', 'request_id': 'req-5c34181d-400e-48ee-bc26-8e85c1bd90c9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.763406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c716defa4f564b66a86fadffeba3302a', 'request_id': 'req-5c34181d-400e-48ee-bc26-8e85c1bd90c9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.769589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c716defa4f564b66a86fadffeba3302a', 'request_id': 'req-5c34181d-400e-48ee-bc26-8e85c1bd90c9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.786865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] The token cache is being invalidate because project c716defa4f564b66a86fadffeba3302a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:42.787233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.788146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.791811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1013/2042] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:42 2022] DELETE /identity/v3/projects/c716defa4f564b66a86fadffeba3302a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:42.796455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:42.822792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93054-3eb0-4f59-ba71-39c5b333ef88 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:42.887398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:42.888564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:42.888825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:42.889092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] PATH_INFO: `/v3/users/1a0080fe99654f9ea6739079709fdd24` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:42.890269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0080fe99654f9ea6739079709fdd24)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:42.892253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:42.957711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0080fe99654f9ea6739079709fdd24'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.969240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0080fe99654f9ea6739079709fdd24'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.977969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0080fe99654f9ea6739079709fdd24'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.979451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0080fe99654f9ea6739079709fdd24'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:42.980083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0080fe99654f9ea6739079709fdd24'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.009857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1030/2043] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:42 2022] DELETE /identity/v3/users/1a0080fe99654f9ea6739079709fdd24 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:43.334986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.337179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.359826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.361309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.362044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34181d-400e-48ee-bc26-8e85c1bd90c9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.418967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.420062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.420343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.420614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] PATH_INFO: `/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.421778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdcb04c4d604383bfc0c8f115574b0a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.423788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.425868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a23f48-34a9-499c-90fc-d6211d073f6f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.430892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.431748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.432059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.432337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] PATH_INFO: `/v3/users/543a71e36bc944e19318ce2ed4e74d8e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.433827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543a71e36bc944e19318ce2ed4e74d8e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.435744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.483335 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdcb04c4d604383bfc0c8f115574b0a', 'request_id': 'req-21562af7-f505-4b67-91f4-3b3d62580f05'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.496198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdcb04c4d604383bfc0c8f115574b0a', 'request_id': 'req-21562af7-f505-4b67-91f4-3b3d62580f05'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.503849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdcb04c4d604383bfc0c8f115574b0a', 'request_id': 'req-21562af7-f505-4b67-91f4-3b3d62580f05'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.511977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543a71e36bc944e19318ce2ed4e74d8e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.516075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] The token cache is being invalidate because project 5bdcb04c4d604383bfc0c8f115574b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:43.516425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.517203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-21562af7-f505-4b67-91f4-3b3d62580f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.519395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1014/2044] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:43 2022] DELETE /identity/v3/projects/5bdcb04c4d604383bfc0c8f115574b0a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:43.521715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543a71e36bc944e19318ce2ed4e74d8e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.525234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824982e7-53ce-4435-88aa-4e31a0ad357f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.525587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824982e7-53ce-4435-88aa-4e31a0ad357f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.525871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824982e7-53ce-4435-88aa-4e31a0ad357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.530381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543a71e36bc944e19318ce2ed4e74d8e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.531218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543a71e36bc944e19318ce2ed4e74d8e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.532092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3ef6d949-20a0-436a-a880-f0e365857d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543a71e36bc944e19318ce2ed4e74d8e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:43.547069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-824982e7-53ce-4435-88aa-4e31a0ad357f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:43.548316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-824982e7-53ce-4435-88aa-4e31a0ad357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.552535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1031/2045] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:43 2022] DELETE /identity/v3/users/543a71e36bc944e19318ce2ed4e74d8e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:43.557030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.557365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.557647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.574395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:43.575576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.606691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1015/2046] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:43.614617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.615012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.615589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.637900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:43.639132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.642972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1032/2047] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:43.648720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1016/2048] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:43.652769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.652919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.654254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:43.662098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca5997-32f6-4a73-ab96-20328bd0b289 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.667075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.667644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.667970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.668286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.668954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:43.669462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.670836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.682948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1017/2049] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:43.688492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.697735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7f6-23dd-4b8d-8a99-679f65f10a6a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.702628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.703295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.703581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.703922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.704650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.706945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.711143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b4bf-1b76-443f-821b-5e0de7258551 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.714699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.715338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.715612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.715923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.726172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.727701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.737073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1018/2050] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:43 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:43.738308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.738594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1033/2051] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:43.810166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b1490-7cbd-4aef-a511-de719724d216 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.815181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.815879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.816159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.816428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.817160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.819108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.839946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1019/2052] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:43 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:43.844255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.863168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0558f-ec42-4c71-ad4b-6eb8cb702b2e service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.875552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.876319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.876605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.876881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.877608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.880047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.896702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1034/2053] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:43.897522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.912220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485fe9-23f8-4e64-97e5-f6e332cea819 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:43.929754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:43.930591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:43.930879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:43.931151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:43.932035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:43.933635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417b02f-75d5-4f98-9208-a18846125ec0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:43.960919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1020/2054] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:43.966169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:43.988227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a1a7-7081-4501-9dfb-626b956b5154 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.004589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.008273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.009251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.010061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] PATH_INFO: `/v3/projects/caae072084334e659615345ea3244116/users/375d18ff45694d46b9e4d58fb6d26834/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.044582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caae072084334e659615345ea3244116, user_id=375d18ff45694d46b9e4d58fb6d26834, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.048770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.075321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1035/2055] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:43 2022] PUT /identity/v3/projects/caae072084334e659615345ea3244116/users/375d18ff45694d46b9e4d58fb6d26834/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:44.077174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.077468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.077740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.122815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] MFA Rules not processed for user `375d18ff45694d46b9e4d58fb6d26834`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:44.125102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.141633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.143442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.229403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1021/2056] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:44.236468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.261927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8d1e-46b7-4cb1-a93b-295475ce78f5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.267275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.268265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.268739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.269070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] PATH_INFO: `/v3/projects/12e2ea126e9b4ddd8b3b736361e30bf3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.270365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e2ea126e9b4ddd8b3b736361e30bf3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.272467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.298735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f10fe-2cec-49b4-8bbb-ca5104da9def None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.304249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.304995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.305339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.305675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.306442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.308460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.340952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e2ea126e9b4ddd8b3b736361e30bf3', 'request_id': 'req-110278d5-380c-4b22-87d9-4a3bbef63d85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.346899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1022/2057] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:44 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:44.347383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e2ea126e9b4ddd8b3b736361e30bf3', 'request_id': 'req-110278d5-380c-4b22-87d9-4a3bbef63d85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.347671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.355950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e2ea126e9b4ddd8b3b736361e30bf3', 'request_id': 'req-110278d5-380c-4b22-87d9-4a3bbef63d85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.367693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] The token cache is being invalidate because project 12e2ea126e9b4ddd8b3b736361e30bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:44.368007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.368920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.371815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1036/2058] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:44 2022] DELETE /identity/v3/projects/12e2ea126e9b4ddd8b3b736361e30bf3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:44.377308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.378976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.419247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad590b-c710-486c-bf43-7992a92ea2e3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.424031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.424708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.424986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.425257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.425935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.428244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.454059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1023/2059] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:44 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:44.454500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110278d5-380c-4b22-87d9-4a3bbef63d85 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.460003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.460167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.460944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.461215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.461483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] PATH_INFO: `/v3/users/7e0a2c644f6944b0964fa87737afa4ff` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.462297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.463130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0a2c644f6944b0964fa87737afa4ff)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.465088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.484499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bef-6fea-4d8b-98cf-f9c5015d9624 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.493262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.493992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.494277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.494561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.495275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.497497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.517252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1024/2060] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:44.518465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.527823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0a2c644f6944b0964fa87737afa4ff'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.535084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6193ef-0902-4774-a3d2-5fdeabc31be2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.538208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0a2c644f6944b0964fa87737afa4ff'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.540170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.541065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.541345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.541633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] PATH_INFO: `/v3/projects/69aa60c334934d84b51889082ccb7a47/users/b6bee14a434548f0839296f850e8e6d6/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.546748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0a2c644f6944b0964fa87737afa4ff'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.547415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0a2c644f6944b0964fa87737afa4ff'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.548088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0a2c644f6944b0964fa87737afa4ff'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:44.558669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aa60c334934d84b51889082ccb7a47, user_id=b6bee14a434548f0839296f850e8e6d6, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.561890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.565514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1037/2061] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:44 2022] DELETE /identity/v3/users/7e0a2c644f6944b0964fa87737afa4ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:44.577048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1025/2062] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:44 2022] PUT /identity/v3/projects/69aa60c334934d84b51889082ccb7a47/users/b6bee14a434548f0839296f850e8e6d6/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:44.581048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.582506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.653825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642b4d0-0d71-4ce4-b7aa-30228dbcea3a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.712576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.713295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.713851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.713851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.714630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.717012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1f2bd-437a-4692-aa8b-a7248cc97b03 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.730090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1038/2063] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:44.734074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.749967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675130-7d38-481a-b1ab-1345cf245282 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.755376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.756682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.756959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.757233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] PATH_INFO: `/v3/projects/69aa60c334934d84b51889082ccb7a47/users/b6bee14a434548f0839296f850e8e6d6/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.759347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aa60c334934d84b51889082ccb7a47, user_id=b6bee14a434548f0839296f850e8e6d6, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.762055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.772631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1026/2064] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:44 2022] PUT /identity/v3/projects/69aa60c334934d84b51889082ccb7a47/users/b6bee14a434548f0839296f850e8e6d6/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:44.782839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.783150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.783558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.810998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] MFA Rules not processed for user `b6bee14a434548f0839296f850e8e6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:44.812251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.865778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.867590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.886883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1039/2065] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:44.898558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:44.900048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:44.950611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3638-a00d-4a81-9704-95598a3734ca admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.955186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.956105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.956384 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.956656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] PATH_INFO: `/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.957819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d7b20b6eee460ea6c5fa9606253cad)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.959825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.960114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fad76-2d52-401a-ba9e-b5259d054ab4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:44.963854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:44.964520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:44.964800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:44.965081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:44.976001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:44.978003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:44.993327 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1040/2066] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:44 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:45.010829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d7b20b6eee460ea6c5fa9606253cad', 'request_id': 'req-aa9885d7-d815-4cbc-b1f6-553223727735'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:45.018610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d7b20b6eee460ea6c5fa9606253cad', 'request_id': 'req-aa9885d7-d815-4cbc-b1f6-553223727735'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:45.024224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d7b20b6eee460ea6c5fa9606253cad', 'request_id': 'req-aa9885d7-d815-4cbc-b1f6-553223727735'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:45.039256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.040420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] The token cache is being invalidate because project f8d7b20b6eee460ea6c5fa9606253cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:45.040766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.041031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:45.041749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-aa9885d7-d815-4cbc-b1f6-553223727735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:45.044235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1027/2067] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:44 2022] DELETE /identity/v3/projects/f8d7b20b6eee460ea6c5fa9606253cad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:45.048906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43f0ad-67ea-4179-8450-01249a7fdc6d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.049317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43f0ad-67ea-4179-8450-01249a7fdc6d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.049594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43f0ad-67ea-4179-8450-01249a7fdc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.055633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a27bb-07e3-4f40-9ff9-a00937aa747e service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.072831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4b43f0ad-67ea-4179-8450-01249a7fdc6d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:45.074070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4b43f0ad-67ea-4179-8450-01249a7fdc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.108824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.109584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.110031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.110251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.112526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.144330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1028/2068] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:45.152356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.152651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.152929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.171828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:45.173395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.185542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1029/2069] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:45.190097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.190264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.191603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.203715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b59e88-533e-4a86-a84b-b1dfa0cdb9f7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.207860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1041/2070] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:45.220834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.221506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.221783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.222050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.222778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:45.223079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.225512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.239598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1030/2071] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:45.244180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.274292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb494-766f-416b-b199-e590cb3cfe06 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.279368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.280121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.280462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.280760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.281510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.284227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.317976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1042/2072] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:45 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:45.322533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.333777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002082a-3a18-4248-850c-06e4a846d150 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.393823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.395590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.395926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.396345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.397224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.399404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.420971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1031/2073] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:45 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:45.428670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.437371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2651878-1ede-4606-98fe-a0225d642d9a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.442280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.443002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.443289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.443590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.444367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.445992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.456837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1043/2074] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:45.460875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.470999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e40d0-acd2-4f2a-83f3-2fa8d00a8264 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.481568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.482245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.482571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.482841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.483581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.485354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5c56-e72c-4e94-bd66-99246ad720bb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.499366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1032/2075] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:45.500592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.511078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c237-44be-4537-9719-9be406dc4673 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.522401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.522401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.522401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.522401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] PATH_INFO: `/v3/projects/cb51a22d10984f9aa43210d990c16c4f/users/24a1d4271d3b45d6a6a34fc4c0810355/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.554632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb51a22d10984f9aa43210d990c16c4f, user_id=24a1d4271d3b45d6a6a34fc4c0810355, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.557500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.574122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1044/2076] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:45 2022] PUT /identity/v3/projects/cb51a22d10984f9aa43210d990c16c4f/users/24a1d4271d3b45d6a6a34fc4c0810355/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:45.588185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.588473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.588744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.616202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] MFA Rules not processed for user `24a1d4271d3b45d6a6a34fc4c0810355`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:45.617397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.681425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1033/2077] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:45.693675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:45.695434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:45.756235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b6f6-4149-4592-ae5a-dc9f93a66967 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:45.760265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:45.760897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:45.761179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:45.761454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:45.770778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:45.772257 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:45.782400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1045/2078] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:47.126904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:47.128527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:47.195708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa08e3f-12cc-4b6e-a702-5b9fc39d91ee None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:47.201568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:47.203244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.203829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.204409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] PATH_INFO: `/v3/users/f315597388e14d6ca2ffa1397d94fa25` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.208571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f315597388e14d6ca2ffa1397d94fa25)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:47.211098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:47.270274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f315597388e14d6ca2ffa1397d94fa25'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.270867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f315597388e14d6ca2ffa1397d94fa25'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.271943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f315597388e14d6ca2ffa1397d94fa25'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.283385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f315597388e14d6ca2ffa1397d94fa25'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.291343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-f0d57248-0a8b-4788-b9f6-836219052e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f315597388e14d6ca2ffa1397d94fa25'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.303902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1034/2079] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:47 2022] DELETE /identity/v3/users/f315597388e14d6ca2ffa1397d94fa25 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:47.478011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:47.495132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaf1c-048f-444e-a663-926af529e293 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:47.574669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:47.575443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.575720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.576028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] PATH_INFO: `/v3/projects/b9cfd646709540a4a85c64b7aeb5a523` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.577297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cfd646709540a4a85c64b7aeb5a523)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:47.579247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:47.626691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cfd646709540a4a85c64b7aeb5a523', 'request_id': 'req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.633385 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cfd646709540a4a85c64b7aeb5a523', 'request_id': 'req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.643169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cfd646709540a4a85c64b7aeb5a523', 'request_id': 'req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.657965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] The token cache is being invalidate because project b9cfd646709540a4a85c64b7aeb5a523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:47.658260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.659101 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-835ef70c-a2bc-4ce8-85b8-f8656e91ed57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:47.661143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1046/2080] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:47 2022] DELETE /identity/v3/projects/b9cfd646709540a4a85c64b7aeb5a523 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:47.666012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.666305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.666584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.685480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:47.686681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:47.755669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1035/2081] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:47.758404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.758694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.758971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.777247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:47.778449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:47.789117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1047/2082] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:47.793578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:47.803457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da48f3-a4af-41c7-930b-0d83db4e412f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:47.808246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:47.808898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.809178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.809451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.810201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:47.810504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:47.812125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:47.823817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1036/2083] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:47.828330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:47.839759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3734f8-ab98-4e55-a9d6-401d90934334 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:47.845532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:47.846167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.846444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.846714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.847402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:47.849330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:47.877427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1048/2084] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:47 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:47.881951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:47.892658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954625c4-5385-4519-ac51-6510f23c9e92 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:47.956546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:47.957409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:47.957923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:47.958417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:47.959708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:47.961852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:47.989974 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1037/2085] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:47 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:47.991644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.002187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce5e9-6343-4a08-ab3c-d4d4b67fe922 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.008097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.008808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.009087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.009352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.010043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.011617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.023221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1049/2086] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:48.027195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.043367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395de9-c382-4326-af6e-2c89bbecd6f9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.050564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.051383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.051661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.051949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.052687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.054266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec517c-fc3a-4453-bb4e-f65cc2227071 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.065746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1038/2087] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:48.069383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.080528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d9340-bca3-4723-8c65-7936980d4ced admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.087581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.088749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.089223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.089729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] PATH_INFO: `/v3/projects/8f5d3a7a94364839a73044d77d825078/users/4cb3777bdbdd489abe318cf358beb5e6/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.112900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5d3a7a94364839a73044d77d825078, user_id=4cb3777bdbdd489abe318cf358beb5e6, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.115789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.131417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1050/2088] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:48 2022] PUT /identity/v3/projects/8f5d3a7a94364839a73044d77d825078/users/4cb3777bdbdd489abe318cf358beb5e6/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:48.142004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.142570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.142570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.170541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] MFA Rules not processed for user `4cb3777bdbdd489abe318cf358beb5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:48.171819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.243688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1039/2089] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:48.248674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.318625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a60ed-a55a-43e6-a4c0-7a1018d02a11 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.324719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.325387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.325662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.325977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.326950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.328884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.357950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1051/2090] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:48.362015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.376710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4aa9e-e88f-4ddc-a65e-ae87fcac5880 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.438891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.439561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.439871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.440177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.440917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.442984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.466321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1040/2091] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:48.467597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.477712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e82ac-c5c7-4348-a621-a14eb806ae50 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.483519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.484211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.484487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.484764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.485566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.487215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.504134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1052/2092] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:48.505448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.515573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6fd1a-8026-4c8f-95a0-f3b256d30adb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.520164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.521035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.521336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.521608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] PATH_INFO: `/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d/users/71688e8e5da641d49b287b47c097419b/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.536700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aeec33d8c0a4fe2a5d8f4137696c19d, user_id=71688e8e5da641d49b287b47c097419b, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.540038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.553679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1041/2093] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:48 2022] PUT /identity/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d/users/71688e8e5da641d49b287b47c097419b/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:48.558254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.569934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16adaa-101a-4f40-860c-7879be6077fb admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.581365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.584197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.629227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.630183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.630464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.630754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.631519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.633151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.642694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1053/2094] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:48.646775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.650871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d54b-d5e0-4893-8029-a3a8103437d1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.655692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.656596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.656771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e87e-5ed5-4275-afb7-d2136a36c528 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.656884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.657147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] PATH_INFO: `/v3/users/375d18ff45694d46b9e4d58fb6d26834` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.658321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=375d18ff45694d46b9e4d58fb6d26834)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.660282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.661341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.662302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.662580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.662851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] PATH_INFO: `/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d/users/71688e8e5da641d49b287b47c097419b/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.664872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aeec33d8c0a4fe2a5d8f4137696c19d, user_id=71688e8e5da641d49b287b47c097419b, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.667465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f272c35-a9f3-4ae4-9371-a0fb701e24a9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.677459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1054/2095] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:48 2022] PUT /identity/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d/users/71688e8e5da641d49b287b47c097419b/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:48.688924 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.689213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.689489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.711366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375d18ff45694d46b9e4d58fb6d26834'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.712034 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375d18ff45694d46b9e4d58fb6d26834'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.712659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375d18ff45694d46b9e4d58fb6d26834'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.715186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] MFA Rules not processed for user `71688e8e5da641d49b287b47c097419b`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:48.716414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.726083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375d18ff45694d46b9e4d58fb6d26834'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.736120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8a9eb354-6ca3-43d4-9fa8-bb047c960eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375d18ff45694d46b9e4d58fb6d26834'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.752270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1042/2096] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:48 2022] DELETE /identity/v3/users/375d18ff45694d46b9e4d58fb6d26834 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:48.756854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.757136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.757410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.775066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:48.776286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.795813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1055/2097] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:48.795813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.795813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.843197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1043/2098] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:48.843880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.845159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.859797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcb1e9-cf67-497b-8ee4-fb7b63fdfabe None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.864360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.865299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.865586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.865854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] PATH_INFO: `/v3/users/24a1d4271d3b45d6a6a34fc4c0810355` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.867062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a1d4271d3b45d6a6a34fc4c0810355)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.869024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.900273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57748117-1c29-4eb5-aa1a-2295a424d5ba None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:48.906815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:48.907612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.907954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.908230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:48.922007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a1d4271d3b45d6a6a34fc4c0810355'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.930244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a1d4271d3b45d6a6a34fc4c0810355'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.937069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a1d4271d3b45d6a6a34fc4c0810355'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.937835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a1d4271d3b45d6a6a34fc4c0810355'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.938535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a1d4271d3b45d6a6a34fc4c0810355'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:48.956360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1056/2099] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:48 2022] DELETE /identity/v3/users/24a1d4271d3b45d6a6a34fc4c0810355 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:48.957360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:48.960321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:48.983471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:48.984964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117dcf8-675f-48ad-8e2a-d02e92f1af6c service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:48.994734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1044/2100] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:48.995863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:48.996153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:48.996434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.013872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:49.015155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.021196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2518cc-3811-4fc8-96ef-87e0ba9038e7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.030985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.031644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.031955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.032236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.034084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.089270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1045/2101] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:49.099318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.107003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.108577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.109609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd71f-d14d-482f-8054-e8c53eaaf139 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.113533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.114234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.114513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.114926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.120653 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1057/2102] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:49.125996 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.127388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.139476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1046/2103] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:49.433251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.435317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.454677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055ed4-c23a-478a-8da5-4d09e3598954 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.468521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.469406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.469690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.469962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] PATH_INFO: `/v3/users/4cb3777bdbdd489abe318cf358beb5e6` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.472566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb3777bdbdd489abe318cf358beb5e6)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.474576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.542699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb3777bdbdd489abe318cf358beb5e6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.552234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.554485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.559928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb3777bdbdd489abe318cf358beb5e6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.572614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8a08-8beb-4693-80f4-fa326ebbeaeb service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.580187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.581117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.581459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.581840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] PATH_INFO: `/v3/projects/caae072084334e659615345ea3244116` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.583298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caae072084334e659615345ea3244116)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.585644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.586459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb3777bdbdd489abe318cf358beb5e6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.587287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb3777bdbdd489abe318cf358beb5e6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.587932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb3777bdbdd489abe318cf358beb5e6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.607599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1058/2104] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:49 2022] DELETE /identity/v3/users/4cb3777bdbdd489abe318cf358beb5e6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:49.608588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.611632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.646194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caae072084334e659615345ea3244116', 'request_id': 'req-d08a7646-26b0-45b7-b40a-fa650055fc37'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.655046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caae072084334e659615345ea3244116', 'request_id': 'req-d08a7646-26b0-45b7-b40a-fa650055fc37'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.660493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caae072084334e659615345ea3244116', 'request_id': 'req-d08a7646-26b0-45b7-b40a-fa650055fc37'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.671305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] The token cache is being invalidate because project caae072084334e659615345ea3244116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:49.671587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.672308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d08a7646-26b0-45b7-b40a-fa650055fc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.674088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1047/2105] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:49 2022] DELETE /identity/v3/projects/caae072084334e659615345ea3244116 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:49.675242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.675523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.675823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.690877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574dbcb-2bc0-4c3d-a1a3-a57e6baaedbd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.692840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:49.694038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.746170 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.747404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.747683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.748063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] PATH_INFO: `/v3/projects/cb51a22d10984f9aa43210d990c16c4f` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.749350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb51a22d10984f9aa43210d990c16c4f)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.749953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1048/2106] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:49.751404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.753869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.755146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.766380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f876b3-344a-4a53-a8a2-e6e3215e6393 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.770947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.771902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.772180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.772452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] PATH_INFO: `/v3/users/b6bee14a434548f0839296f850e8e6d6` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.773631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bee14a434548f0839296f850e8e6d6)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.775656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:49.810850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb51a22d10984f9aa43210d990c16c4f', 'request_id': 'req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.816561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb51a22d10984f9aa43210d990c16c4f', 'request_id': 'req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.825380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb51a22d10984f9aa43210d990c16c4f', 'request_id': 'req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.827802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bee14a434548f0839296f850e8e6d6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.828440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bee14a434548f0839296f850e8e6d6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.829083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bee14a434548f0839296f850e8e6d6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.836270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] The token cache is being invalidate because project cb51a22d10984f9aa43210d990c16c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:49.836569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.837193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.838799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1059/2107] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:49 2022] DELETE /identity/v3/projects/cb51a22d10984f9aa43210d990c16c4f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:49.842433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:49.842526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bee14a434548f0839296f850e8e6d6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.843425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.849548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-34b20aa1-0713-464b-859e-24661359d28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bee14a434548f0839296f850e8e6d6'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:49.862135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1049/2108] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:49 2022] DELETE /identity/v3/users/b6bee14a434548f0839296f850e8e6d6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:49.863531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe8f7-129c-4ead-9dc2-223094080eb8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.863835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe8f7-129c-4ead-9dc2-223094080eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.864107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe8f7-129c-4ead-9dc2-223094080eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.882634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-23bfe8f7-129c-4ead-9dc2-223094080eb8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:49.883847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-23bfe8f7-129c-4ead-9dc2-223094080eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.906242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096ddc-e003-43c7-bcd1-d4eb1a3875a0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:49.957736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1050/2109] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:49.968363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.968363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.968772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.974059 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:49.974859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:49.975172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:49.975448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:49.979184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.990604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:49.991889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:49.993693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:49.995060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.000852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1051/2110] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:50.010747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.010852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1060/2111] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:50.014570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbd3b5-1766-4f43-9e7e-486820903e38 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.019691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.020409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.020685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.020956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.021714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:50.022026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.023613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.040938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1052/2112] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:50.041386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.051025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29580a-140c-40db-98ab-fcb1321225ae service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.057842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.058000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.058530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.058638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.059333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.061323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.111815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1061/2113] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:50.116182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.127618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3a569-c9af-44ef-822c-e14614a3d5b3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.154345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.156442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.209526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.210494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.210769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.211039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.215856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.217875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.241555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d44f2-61d1-4511-8e5d-6483dc8742e6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.245982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1053/2114] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:50.246995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.247141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.247894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.248172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.248442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] PATH_INFO: `/v3/projects/69aa60c334934d84b51889082ccb7a47` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.249684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69aa60c334934d84b51889082ccb7a47)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.251956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.256911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9aec-0834-40be-980b-d995a84513ed admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.261994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.263238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.263811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.263811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.264536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.266132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.279309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1054/2115] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:50.282459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.295241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090746-811d-45bc-8a5c-f1575b830cc6 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.304867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69aa60c334934d84b51889082ccb7a47', 'request_id': 'req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.319351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69aa60c334934d84b51889082ccb7a47', 'request_id': 'req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.339393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69aa60c334934d84b51889082ccb7a47', 'request_id': 'req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.357961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] The token cache is being invalidate because project 69aa60c334934d84b51889082ccb7a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:50.358256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.358941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.360590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1062/2116] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:50 2022] DELETE /identity/v3/projects/69aa60c334934d84b51889082ccb7a47 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:50.362854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.364328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.398429 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.399129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.399405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.399677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.400435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.402051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c0c35-26e6-40c4-85db-7f5880169cc0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.413328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1055/2117] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:50.413328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.413574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.413878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.432113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:50.433291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.441359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1056/2118] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:50.442194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.443490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.454894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2653a99-a0a9-4c89-be09-88a3e2ebc7e9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.455664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310f05-90aa-4df1-98f4-9e1a4baa3110 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.460427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.460562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.461333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.461610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.461878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] PATH_INFO: `/v3/projects/a44af6cd632940b28b16e3e01dde4cc4/users/f49e2e017f26489eb36c1f18d403edd2/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.462174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.462640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.462978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] PATH_INFO: `/v3/projects/8f5d3a7a94364839a73044d77d825078` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.464455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5d3a7a94364839a73044d77d825078)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.467149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.476524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44af6cd632940b28b16e3e01dde4cc4, user_id=f49e2e017f26489eb36c1f18d403edd2, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.479466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315badad-0e66-4198-bb39-36627b944dcb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.494238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1057/2119] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:50 2022] PUT /identity/v3/projects/a44af6cd632940b28b16e3e01dde4cc4/users/f49e2e017f26489eb36c1f18d403edd2/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:50.495975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.496437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.496829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.515753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:50.517181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.520802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5d3a7a94364839a73044d77d825078', 'request_id': 'req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.532167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5d3a7a94364839a73044d77d825078', 'request_id': 'req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.541994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5d3a7a94364839a73044d77d825078', 'request_id': 'req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.553721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] The token cache is being invalidate because project 8f5d3a7a94364839a73044d77d825078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:50.554303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.554830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-13a86ec0-b42a-4fdd-bfa6-a41957e066b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.556744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1063/2120] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:50 2022] DELETE /identity/v3/projects/8f5d3a7a94364839a73044d77d825078 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:50.557742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.558281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.558562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.586533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] MFA Rules not processed for user `f49e2e017f26489eb36c1f18d403edd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:50.587738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.589795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1058/2121] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:50.590579 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.591824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.602825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24098dae-00f1-475e-9639-6c8ed0e64273 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.607558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.608433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.608711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.608972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] PATH_INFO: `/v3/users/71688e8e5da641d49b287b47c097419b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.610130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71688e8e5da641d49b287b47c097419b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.612060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.654333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1064/2122] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:50.655250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.664267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71688e8e5da641d49b287b47c097419b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.665042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71688e8e5da641d49b287b47c097419b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.665647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71688e8e5da641d49b287b47c097419b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.666491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737c22-1b2c-48dc-9730-83dd10ae0b58 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.671966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.672672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.672937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.673246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.674053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:50.674364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.675992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.678191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71688e8e5da641d49b287b47c097419b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.686657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71688e8e5da641d49b287b47c097419b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:50.692304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1065/2123] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:50.692304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.692304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.699113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1059/2124] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:50 2022] DELETE /identity/v3/users/71688e8e5da641d49b287b47c097419b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:50.699928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.701258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.761504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f329f4-c660-4150-aced-285c1b5bb417 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.767942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955496e0-23c4-45f6-b49b-fb84582f2f93 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.773389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.774312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.774883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.775174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.775892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.777801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.806408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1060/2125] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:50.810774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.814688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.815330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.815673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.815944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.817846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:50.880124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3676854-1b02-4b21-896b-c7040b3ac6d9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.885721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.886395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.886674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.886946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.887636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.889591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.891419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.892957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.902415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1066/2126] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:50.924222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1061/2127] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:50 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:50.928346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.939738 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389451-6116-42b5-b28d-8e6422212669 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.945962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.946634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.946907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.947267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.948408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.950574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:50.964497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1067/2128] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:50.965677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:50.976197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9347130-37c5-4ed6-8b3c-858d04fb0042 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:50.983930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:50.984615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:50.984893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:50.985163 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:50.985935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:50.990111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.001466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1062/2129] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:51.005186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.020723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cd8f-bd5b-4ddc-be94-f2a7b51531e4 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.027064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.028070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.028489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.028793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] PATH_INFO: `/v3/projects/9a965633bf894fc89463834457eee585/users/302e353217504e3cbc6cdde28144ad67/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.034960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.037340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.059600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379ccb-24c6-47db-9878-24f7e04320cf admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.065749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.066568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.066920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.067119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] PATH_INFO: `/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.068538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aeec33d8c0a4fe2a5d8f4137696c19d)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.070594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.075689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a965633bf894fc89463834457eee585, user_id=302e353217504e3cbc6cdde28144ad67, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.078950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b5a4a-cc95-4f82-bd52-c99a80680ec2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.093803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1068/2130] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:51 2022] PUT /identity/v3/projects/9a965633bf894fc89463834457eee585/users/302e353217504e3cbc6cdde28144ad67/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:51.105472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.106064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.106348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.129269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aeec33d8c0a4fe2a5d8f4137696c19d', 'request_id': 'req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:51.134351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] MFA Rules not processed for user `302e353217504e3cbc6cdde28144ad67`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:51.135586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.139275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aeec33d8c0a4fe2a5d8f4137696c19d', 'request_id': 'req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:51.146445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aeec33d8c0a4fe2a5d8f4137696c19d', 'request_id': 'req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:51.158085 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] The token cache is being invalidate because project 0aeec33d8c0a4fe2a5d8f4137696c19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:51.158374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:51.159038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fdd5ad6b-bc1c-4ba3-9f01-ebae5d4a0dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:51.160631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1063/2131] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:51 2022] DELETE /identity/v3/projects/0aeec33d8c0a4fe2a5d8f4137696c19d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:51.165528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811edc-71bf-4f5c-82d7-4d455d02afde None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.165971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811edc-71bf-4f5c-82d7-4d455d02afde None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.166396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811edc-71bf-4f5c-82d7-4d455d02afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.184875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1b811edc-71bf-4f5c-82d7-4d455d02afde None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:51.185988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1b811edc-71bf-4f5c-82d7-4d455d02afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.223921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1069/2132] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:51.225158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.226802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.268500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1064/2133] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:51.276491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.276779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.277054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.296745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2cbd-221e-4689-ac9f-636f8e6c68ab None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.297502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:51.299188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.302870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.303529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.303841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.304113 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.304815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.306822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.309461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1065/2134] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:51.313562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.325949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241014-376a-4965-9675-4bfe27982f08 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.331222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.331883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.332162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.332437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.333298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:51.333604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.335399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.358675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1070/2135] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:51.359687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.376104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1066/2136] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:51.377508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.391985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94124-2855-4600-9aca-648e387ac68d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.435582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cad8-1089-449a-8067-e304d0389aa6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.440701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.441365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.441643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.441913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.442598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.444574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.452446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.453200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.453486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.453771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.454599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.456725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.465991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1071/2137] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:51.470239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.479867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da99e-4cf3-42d7-b08c-baf803ad01c2 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.484385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1067/2138] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:51.484511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.484917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.485201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.485472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.486181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.487803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.488390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.499795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1072/2139] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:51.501589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.517189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f94496-1de3-4b2e-998b-fa7c82e4b5cc admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.547447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaee1-3a89-48d0-b7d4-cf811220cb6a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.553361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.554019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.554304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.554597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.555248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.557352 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.579207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1068/2140] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:51.582589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.583014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.583965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.584253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.584531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] PATH_INFO: `/v3/projects/779097a3a1ea450c9efbf17ede84234e/users/6e6592d2d69343038306ea5754b9e349/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.593050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d771-2774-4e33-a2ab-1378f26e09da admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.599486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.600277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.600561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.600894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.601743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.603434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.604065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] RBAC: Authorizing `identity:create_grant(project_id=779097a3a1ea450c9efbf17ede84234e, user_id=6e6592d2d69343038306ea5754b9e349, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.610180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.631902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1069/2141] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:51.637371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.638098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1073/2142] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:51 2022] PUT /identity/v3/projects/779097a3a1ea450c9efbf17ede84234e/users/6e6592d2d69343038306ea5754b9e349/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:51.642049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.649519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e01e-e700-4f2c-9d85-ad7439b38f99 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.712449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c333b9-5e7f-4321-936a-65db5487193d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.716958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.717613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.717892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.718166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.718885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.719881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.720542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.720650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.721095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.721380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.722105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.723746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.730597 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1074/2143] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:51.737619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1070/2144] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:51.737759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.738516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.744322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5984e-c4c6-454d-8d0a-02fe276718d5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.748028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87e23a-4752-49e1-b5a2-957b1020c5f9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.748867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.749727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.750004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.750275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] PATH_INFO: `/v3/projects/779097a3a1ea450c9efbf17ede84234e/users/6e6592d2d69343038306ea5754b9e349/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.752276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] RBAC: Authorizing `identity:create_grant(project_id=779097a3a1ea450c9efbf17ede84234e, user_id=6e6592d2d69343038306ea5754b9e349, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.753293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.754193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.754524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.754849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] PATH_INFO: `/v3/projects/1049643386ee47fc905dadb41c9d228f/users/9d5681062f824252bc6b7adb3bcb7f7e/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.754937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15fe12-9888-40dc-8b69-8243a94b654b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.765502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1075/2145] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:51 2022] PUT /identity/v3/projects/779097a3a1ea450c9efbf17ede84234e/users/6e6592d2d69343038306ea5754b9e349/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:51.769790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1049643386ee47fc905dadb41c9d228f, user_id=9d5681062f824252bc6b7adb3bcb7f7e, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.772541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9003-0093-4649-bfc2-d8f2c4cbeae7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.775686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.776023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.776328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.787565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1071/2146] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:51 2022] PUT /identity/v3/projects/1049643386ee47fc905dadb41c9d228f/users/9d5681062f824252bc6b7adb3bcb7f7e/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:51.799129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.799548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.799950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.805040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] MFA Rules not processed for user `6e6592d2d69343038306ea5754b9e349`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:51.806303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.828089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] MFA Rules not processed for user `9d5681062f824252bc6b7adb3bcb7f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:51.829285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.878253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1076/2147] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:51.889450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.890814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:51.894485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1072/2148] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:51.898947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:51.946430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c02ca-2881-43f1-9ac2-cdd25fd75447 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.950261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.950901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.951184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.951456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.960671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.961280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293426d-e3f1-4bb0-bbd0-5680d786f01f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:51.962390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.966492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:51.967042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:51.967314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:51.967597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:51.968307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:51.970205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:51.973270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1077/2149] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:51.996240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1073/2150] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:52.000513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.011074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a258-f7f4-4849-8568-c4e6d4d7ce56 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.067930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.073168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.073986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.074353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.074720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.075561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.077613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.101268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1078/2151] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:51 2022] POST /identity/v3/users => generated 306 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:54:52.102709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.114554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0724-c2c4-4900-8473-12bf6cdd61df admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.120137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.121691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.122268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.122959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.123943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.125670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.128501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63ceb-a771-4c32-8f38-716ad01521d0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.132343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.133018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.133347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.133615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.137063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1079/2152] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:54:52.148878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.161295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee427-5dc8-4fef-8b42-f0ba822344be admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.167117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.168040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.168401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.168677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] PATH_INFO: `/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5/users/5c7add1e59d04d2fbd34e37e083abbdd/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.185535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25dc93bbbfb49af8d95a6fa55943bd5, user_id=5c7add1e59d04d2fbd34e37e083abbdd, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.188416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.199744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.201931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.213778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1080/2153] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:52 2022] PUT /identity/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5/users/5c7add1e59d04d2fbd34e37e083abbdd/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:52.215148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.226658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1074/2154] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:52.298675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce610a8-df52-4b50-8bb2-d91f173f9eba admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.308270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.309230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.309589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.309986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.310815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.312568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62ed6a-35d8-42f7-9899-33a2fcb62d71 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.323859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1081/2155] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:52.328361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.341011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2adfaa-a62f-4e34-bc27-0dfdc4770c42 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.347998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.349015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.349424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.349701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] PATH_INFO: `/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5/users/5c7add1e59d04d2fbd34e37e083abbdd/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.351686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25dc93bbbfb49af8d95a6fa55943bd5, user_id=5c7add1e59d04d2fbd34e37e083abbdd, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.354870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.379083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1075/2156] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:52 2022] PUT /identity/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5/users/5c7add1e59d04d2fbd34e37e083abbdd/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:52.390272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.390712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.391104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.423124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] MFA Rules not processed for user `5c7add1e59d04d2fbd34e37e083abbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:52.424674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:52.519687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1082/2157] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:52.563384 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.624205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a625f1-ddae-4cd5-b0f7-d9e56353ee48 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.628255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.629032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.629337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.629677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.645992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.647739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.658696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.665374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1076/2158] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:52.737940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d617c3-e6ba-4afb-a6a7-2b4d0caf5b90 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.742193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.743217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.743584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.743956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] PATH_INFO: `/v3/users/302e353217504e3cbc6cdde28144ad67` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.745309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302e353217504e3cbc6cdde28144ad67)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.747544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.756090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.757577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:52.770706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229396-e4e7-44f0-8f6c-2acf92971bc8 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:52.774631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:52.775386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.775850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.776314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.800969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302e353217504e3cbc6cdde28144ad67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:52.809823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302e353217504e3cbc6cdde28144ad67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:52.817387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302e353217504e3cbc6cdde28144ad67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:52.818082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302e353217504e3cbc6cdde28144ad67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:52.818799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5f232e21-a49b-45d1-b825-f68e8f6c5666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302e353217504e3cbc6cdde28144ad67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:52.838602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1083/2159] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:52 2022] DELETE /identity/v3/users/302e353217504e3cbc6cdde28144ad67 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:52.843126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:52.843415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:52.843689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:52.844084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:52.845531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:52.856440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1077/2160] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:52.862128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:52.863350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:52.929847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1084/2161] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:52.936698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:52.938221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:52.993855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6630c52-9b64-4cf9-9b72-33acfa253cc5 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:53.044904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:53.045605 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:53.045884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:53.046155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:53.056777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:53.058435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:53.068651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1078/2162] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:53.359136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:53.360767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:53.373122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda38c9-e2f8-403c-a48f-a936d24e4b1c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:53.378950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:53.379969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:53.380341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:53.380700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] PATH_INFO: `/v3/projects/9a965633bf894fc89463834457eee585` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:53.382154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a965633bf894fc89463834457eee585)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:53.384227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:53.432572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a965633bf894fc89463834457eee585', 'request_id': 'req-852515ab-e6b5-495c-bc0a-64733d0c538b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.438173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a965633bf894fc89463834457eee585', 'request_id': 'req-852515ab-e6b5-495c-bc0a-64733d0c538b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.447667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a965633bf894fc89463834457eee585', 'request_id': 'req-852515ab-e6b5-495c-bc0a-64733d0c538b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.459017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] The token cache is being invalidate because project 9a965633bf894fc89463834457eee585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:53.459304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.460019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.462050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1085/2163] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:53 2022] DELETE /identity/v3/projects/9a965633bf894fc89463834457eee585 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:53.465834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:53.476454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204c9cf-e921-4c8e-a4c9-05c984624bb4 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:53.541793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:53.542781 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:53.543061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:53.543334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] PATH_INFO: `/v3/users/6e6592d2d69343038306ea5754b9e349` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:53.544533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6592d2d69343038306ea5754b9e349)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:53.546614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:53.615347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6592d2d69343038306ea5754b9e349'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.616419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6592d2d69343038306ea5754b9e349'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.617050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6592d2d69343038306ea5754b9e349'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.629661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6592d2d69343038306ea5754b9e349'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.638709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-da9ffbc7-df2e-4d32-9d29-329120a236b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6592d2d69343038306ea5754b9e349'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:53.651652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1079/2164] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:53 2022] DELETE /identity/v3/users/6e6592d2d69343038306ea5754b9e349 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:53.937427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:53.938937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:53.958191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852515ab-e6b5-495c-bc0a-64733d0c538b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.014537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.015395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.015669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.015972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] PATH_INFO: `/v3/projects/779097a3a1ea450c9efbf17ede84234e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.017139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779097a3a1ea450c9efbf17ede84234e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.019042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.063493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779097a3a1ea450c9efbf17ede84234e', 'request_id': 'req-c6690110-1f6a-4035-954d-2457d4b924f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.068810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779097a3a1ea450c9efbf17ede84234e', 'request_id': 'req-c6690110-1f6a-4035-954d-2457d4b924f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.077016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779097a3a1ea450c9efbf17ede84234e', 'request_id': 'req-c6690110-1f6a-4035-954d-2457d4b924f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.087521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] The token cache is being invalidate because project 779097a3a1ea450c9efbf17ede84234e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:54.087827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.088444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c6690110-1f6a-4035-954d-2457d4b924f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.089979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1086/2165] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:53 2022] DELETE /identity/v3/projects/779097a3a1ea450c9efbf17ede84234e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:54.094905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.095188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.095461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.113726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:54.115009 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:54.178355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1080/2166] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:54:54.187145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.187430 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.187699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.206650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:54.207906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:54.216584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1087/2167] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:54.220746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.230954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9602c-1633-48c2-8e18-1dd2f45938b3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.236129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.236782 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.237062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.237305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.238030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:54.238325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.240005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.251739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1081/2168] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:54:54.256348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.265773 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ec2f2-29ca-4567-ac9a-3293aabdfc91 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.271015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.271740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.272053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.272322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.273025 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.274895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.301978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1088/2169] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:54.307887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.323670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e33df-311d-4899-b84a-b4fc900acfc0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.384695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.385359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.385636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.385908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.386591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.388554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.409510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1082/2170] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:54.413970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.424160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb93c1-ba4a-4a58-b2e8-2c214a3d5337 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.429022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.429669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.429970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.430220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.430944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.432583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.443073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1089/2171] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:54.447369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.460492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ffc4-ac3e-426f-9a14-ec10500256e0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.465521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.466186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.466461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.466727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.467431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.469055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c676c-e97e-424d-b5cf-111857476f1b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.479687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1083/2172] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:54.483921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.495668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a00c0-57a3-4b04-bbff-523327b84634 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.501736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.502612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.502898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.503161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] PATH_INFO: `/v3/projects/cf348be3a03d42d5b5b1117a2c42db94/users/edc25bf4197c4a55a1228e1b2b0779b8/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.519259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf348be3a03d42d5b5b1117a2c42db94, user_id=edc25bf4197c4a55a1228e1b2b0779b8, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.521989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.539443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1090/2173] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:54 2022] PUT /identity/v3/projects/cf348be3a03d42d5b5b1117a2c42db94/users/edc25bf4197c4a55a1228e1b2b0779b8/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:54:54.549866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.550146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.550436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.578148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] MFA Rules not processed for user `edc25bf4197c4a55a1228e1b2b0779b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:54.579341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:54.641704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1084/2174] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:54.653346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.655175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:54.712603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0c549-2529-4f0c-9eb9-db18d695a6e8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.719330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.720344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.720743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.721134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.731903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.733367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348875f6-a33e-4764-a170-041c0c294a0e service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.742665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1091/2175] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:54.762442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:54.826506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b4f35-d7b2-4991-b944-40d64fe1ad48 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:54.831087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:54.831933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.832212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.832483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] PATH_INFO: `/v3/users/edc25bf4197c4a55a1228e1b2b0779b8` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.833673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc25bf4197c4a55a1228e1b2b0779b8)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:54.835583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:54.885726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc25bf4197c4a55a1228e1b2b0779b8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.886426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc25bf4197c4a55a1228e1b2b0779b8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.887063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc25bf4197c4a55a1228e1b2b0779b8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.898381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc25bf4197c4a55a1228e1b2b0779b8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.907202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc25bf4197c4a55a1228e1b2b0779b8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:54.923535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1085/2176] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:54:54 2022] DELETE /identity/v3/users/edc25bf4197c4a55a1228e1b2b0779b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:54.929510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:54.929796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:54.930068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:54.947869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:54.949050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:55.008553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1092/2177] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:55.021353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.022917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:55.085865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241dea7-e633-4a58-8810-6db6893c6783 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.090330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.090982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.091258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.091529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.101184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.102624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970f14-b3ef-446e-8772-558174aea52f service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.112441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1086/2178] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:54:55.439507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.441055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:55.453205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437518-1fb0-49c6-b465-bcb23b9c5860 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.459004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.459902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.460179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.460452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] PATH_INFO: `/v3/projects/cf348be3a03d42d5b5b1117a2c42db94` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.461757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf348be3a03d42d5b5b1117a2c42db94)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.463705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.516985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf348be3a03d42d5b5b1117a2c42db94', 'request_id': 'req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:55.523281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf348be3a03d42d5b5b1117a2c42db94', 'request_id': 'req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:55.532203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf348be3a03d42d5b5b1117a2c42db94', 'request_id': 'req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:55.543546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] The token cache is being invalidate because project cf348be3a03d42d5b5b1117a2c42db94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:54:55.543930 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:55.544573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b85a6f4d-140c-4db4-9fd3-035cf04f27dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:54:55.546163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1093/2179] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:54:55 2022] DELETE /identity/v3/projects/cf348be3a03d42d5b5b1117a2c42db94 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:55.552698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.552909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.553223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.570632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:55.571869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:55.630229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1087/2180] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:55.637988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.638218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.638492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.657177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:55.658364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:55.667006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1094/2181] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:55.671175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.681709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6690b8-e943-4e23-b720-acc555ada186 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.686387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.687037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.687318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.687586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.688333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:54:55.688632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.690216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.701272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1088/2182] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:54:55.705300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.715214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7beeb-8695-47ac-a5a6-53f71d35f359 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.720677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.721322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.721599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.721869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.722555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.724499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.753259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1095/2183] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:54:55 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:55.757382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.767147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8479b0-8b4d-4928-8e57-1b7e1adfbe44 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.827359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.829527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.829700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.829972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.835103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.835103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.855521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1089/2184] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:54:55 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:54:55.859941 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.871429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d89fe-2029-4619-92ad-f8eac2a4d6b8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.876389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.877044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.877322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.877571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.878290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.879918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.890194 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1096/2185] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:55.894484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.906424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a6bf-fe55-47b8-97f3-9d4c13767b6a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.911527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.912211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.912516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.912812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.913496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.915094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f85fa-7ab5-4f16-9d3f-ea399273e093 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.925836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1090/2186] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:54:55.930756 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:55.941287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a101d-b2b4-4248-9b39-a1a5376bde3e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:55.946469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:55.947341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.947619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.947931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] PATH_INFO: `/v3/projects/ffda909ab345414b8962364cf2f5738f/users/f3e7163264a04db9a3b18aea3ae7631b/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:55.962763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffda909ab345414b8962364cf2f5738f, user_id=f3e7163264a04db9a3b18aea3ae7631b, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:55.965476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:55.981473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1097/2187] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:54:55 2022] PUT /identity/v3/projects/ffda909ab345414b8962364cf2f5738f/users/f3e7163264a04db9a3b18aea3ae7631b/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:54:55.986613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853dcf-0e66-42aa-948e-7a73ab39d542 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:55.987005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853dcf-0e66-42aa-948e-7a73ab39d542 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:55.987322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853dcf-0e66-42aa-948e-7a73ab39d542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:56.005625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d8853dcf-0e66-42aa-948e-7a73ab39d542 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:54:56.006800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d8853dcf-0e66-42aa-948e-7a73ab39d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:56.071162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1091/2188] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:54:56.081160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:54:56.083310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:54:56.146949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a43-0ec0-4fd1-9c69-ae2bb1b7598c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:54:56.151166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:54:56.151795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:54:56.152115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:54:56.152394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:54:56.162303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:54:56.163856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:54:56.173468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1098/2189] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:00.717194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:00.717710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:00.717906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:00.747967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] MFA Rules not processed for user `f3e7163264a04db9a3b18aea3ae7631b`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:00.749247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:00.826906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1092/2190] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:00.830919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:00.841716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4da39-8d40-41e2-b64f-9dc7496cf513 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:00.848084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:00.849240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:00.849526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:00.849803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:00.850663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:00.853829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:00.883251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1099/2191] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:00 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:00.888785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:00.898953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd93324-de6a-4828-b629-9c3af71bd909 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:00.973133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:00.973887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:00.974232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:00.974435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:00.975166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:00.977291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:01.002976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1093/2192] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:00 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:01.004354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:01.014860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f89b-c717-4e02-90a8-ccd8cf725781 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:01.019533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:01.020238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:01.020519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:01.020916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:01.021636 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:01.023244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:01.035365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1100/2193] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:01.039185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:01.049404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d401b-870b-495b-ad9c-75851a8627ed admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:01.054705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:01.055687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:01.056089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:01.056362 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] PATH_INFO: `/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1/users/af873f70f51c4c2eb53c28c0a67d1a54/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:01.073615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdd597eaaa4423ca14cb656c5e663e1, user_id=af873f70f51c4c2eb53c28c0a67d1a54, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:01.076416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:01.090371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1094/2194] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:01 2022] PUT /identity/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1/users/af873f70f51c4c2eb53c28c0a67d1a54/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:01.094444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:01.104719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501f2fb-07b6-4f98-a056-7973933174be admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:01.160874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:01.161557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:01.161916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:01.162147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:01.162797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:01.164423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:01.175318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1101/2195] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:01.179475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:01.189626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67995-395d-43b5-a7c6-9c9df27c1715 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:01.194765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:01.195599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:01.195906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:01.196179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] PATH_INFO: `/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1/users/af873f70f51c4c2eb53c28c0a67d1a54/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:01.198201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdd597eaaa4423ca14cb656c5e663e1, user_id=af873f70f51c4c2eb53c28c0a67d1a54, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:01.205364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7311-c856-43bd-b096-2fc89bc62ed1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:01.215740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1095/2196] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:01 2022] PUT /identity/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1/users/af873f70f51c4c2eb53c28c0a67d1a54/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:02.331073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:02.333054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:02.346576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082b33-ed43-4850-bd05-6662931f7769 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:02.419208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:02.420531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:02.421187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:02.421656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] PATH_INFO: `/v3/users/f49e2e017f26489eb36c1f18d403edd2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:02.423204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49e2e017f26489eb36c1f18d403edd2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:02.425484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:02.497662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49e2e017f26489eb36c1f18d403edd2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:02.513162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49e2e017f26489eb36c1f18d403edd2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:02.541863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49e2e017f26489eb36c1f18d403edd2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:02.542667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49e2e017f26489eb36c1f18d403edd2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:02.544835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49e2e017f26489eb36c1f18d403edd2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:02.584102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1102/2197] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:02 2022] DELETE /identity/v3/users/f49e2e017f26489eb36c1f18d403edd2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:02.585459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:02.585937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:02.586043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:02.605632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:02.606836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:02.684872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1096/2198] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:02.692632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:02.694682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:02.760020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1a22-09af-4f4f-9abd-317d90ee072b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:02.763846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:02.764500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:02.764935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:02.765214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:02.775337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:02.776804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:02.790352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1103/2199] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:03.143378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:03.145124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:03.161819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55792-bee3-4e6a-9c6c-39684966db94 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:03.174456 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:03.175710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:03.176777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:03.177081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] PATH_INFO: `/v3/projects/a44af6cd632940b28b16e3e01dde4cc4` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:03.180128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44af6cd632940b28b16e3e01dde4cc4)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:03.183360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:03.260718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44af6cd632940b28b16e3e01dde4cc4', 'request_id': 'req-263c727e-aa54-4eb5-ab64-54efd7fad7c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:03.280350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44af6cd632940b28b16e3e01dde4cc4', 'request_id': 'req-263c727e-aa54-4eb5-ab64-54efd7fad7c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:03.299601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44af6cd632940b28b16e3e01dde4cc4', 'request_id': 'req-263c727e-aa54-4eb5-ab64-54efd7fad7c5'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:03.325336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] The token cache is being invalidate because project a44af6cd632940b28b16e3e01dde4cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:03.325881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:03.328735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-263c727e-aa54-4eb5-ab64-54efd7fad7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:03.332001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1097/2200] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:03 2022] DELETE /identity/v3/projects/a44af6cd632940b28b16e3e01dde4cc4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:04.688543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:04.691418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:04.707212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a167ca3-33b5-48a7-a1c1-3ecf0ddeb1ea service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:04.790866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:04.792052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:04.792840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:04.793394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] PATH_INFO: `/v3/users/9d5681062f824252bc6b7adb3bcb7f7e` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:04.795363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5681062f824252bc6b7adb3bcb7f7e)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:04.803084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:04.919183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5681062f824252bc6b7adb3bcb7f7e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:04.928782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5681062f824252bc6b7adb3bcb7f7e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:04.941117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5681062f824252bc6b7adb3bcb7f7e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:04.942451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5681062f824252bc6b7adb3bcb7f7e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:04.943212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5681062f824252bc6b7adb3bcb7f7e'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:04.978796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1104/2201] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:04 2022] DELETE /identity/v3/users/9d5681062f824252bc6b7adb3bcb7f7e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:04.980327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:04.980826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:04.981423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:05.007627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:05.008967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:05.137433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1098/2202] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:05.144480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:05.146603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:05.300393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5de66-c4cc-4a7b-b752-431f69357984 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:05.316229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:05.316946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:05.318745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:05.319033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:05.341517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:05.346189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddbf23-c4f2-4290-a4cf-d9c5d988e710 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:05.374255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1105/2203] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:55:06.440822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:06.442476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:06.461173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ece705-ffd8-4341-aaa3-68d7099d4de3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:06.491017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:06.492424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:06.492764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:06.493097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] PATH_INFO: `/v3/projects/1049643386ee47fc905dadb41c9d228f` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:06.494440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1049643386ee47fc905dadb41c9d228f)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:06.496537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:06.570394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1049643386ee47fc905dadb41c9d228f', 'request_id': 'req-c07cc4fd-71a6-460c-b73e-fa177171bf65'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.582833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1049643386ee47fc905dadb41c9d228f', 'request_id': 'req-c07cc4fd-71a6-460c-b73e-fa177171bf65'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.592880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1049643386ee47fc905dadb41c9d228f', 'request_id': 'req-c07cc4fd-71a6-460c-b73e-fa177171bf65'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.608716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] The token cache is being invalidate because project 1049643386ee47fc905dadb41c9d228f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:06.608716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.621288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.623852 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:06.624319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1099/2204] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:06 2022] DELETE /identity/v3/projects/1049643386ee47fc905dadb41c9d228f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:06.627554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:06.629803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:06.643047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:06.643335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:06.692551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] MFA Rules not processed for user `af873f70f51c4c2eb53c28c0a67d1a54`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:06.693775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:06.712248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cc4fd-71a6-460c-b73e-fa177171bf65 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:06.716827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:06.717696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:06.717966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:06.718233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] PATH_INFO: `/v3/users/5c7add1e59d04d2fbd34e37e083abbdd` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:06.719396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7add1e59d04d2fbd34e37e083abbdd)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:06.721350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:06.772580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7add1e59d04d2fbd34e37e083abbdd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.773450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7add1e59d04d2fbd34e37e083abbdd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.774194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7add1e59d04d2fbd34e37e083abbdd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.782349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1106/2205] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:06.790893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:06.791473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7add1e59d04d2fbd34e37e083abbdd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.792435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:06.801578 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7add1e59d04d2fbd34e37e083abbdd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:06.815358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1100/2206] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:06 2022] DELETE /identity/v3/users/5c7add1e59d04d2fbd34e37e083abbdd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:06.887663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c9c3-a5d0-486e-9034-e9b068a00b44 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:06.961167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:06.961864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:06.962976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:06.963240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:06.965198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:07.030623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.037090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682c1f9-4db2-4b10-948f-de4903e24281 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.047505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1107/2207] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:07.111331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.112804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:07.214465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970e2b-cdf1-4652-a8fb-d869ada6ef96 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.220277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.221155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.221501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.221826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] PATH_INFO: `/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.223041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25dc93bbbfb49af8d95a6fa55943bd5)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.227501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.311844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25dc93bbbfb49af8d95a6fa55943bd5', 'request_id': 'req-8747a714-1737-47ee-8be4-ade88dad2b00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:07.320622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25dc93bbbfb49af8d95a6fa55943bd5', 'request_id': 'req-8747a714-1737-47ee-8be4-ade88dad2b00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:07.327959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25dc93bbbfb49af8d95a6fa55943bd5', 'request_id': 'req-8747a714-1737-47ee-8be4-ade88dad2b00'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:07.339118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] The token cache is being invalidate because project e25dc93bbbfb49af8d95a6fa55943bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:07.339403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:07.340073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8747a714-1737-47ee-8be4-ade88dad2b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:07.341713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1101/2208] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:07 2022] DELETE /identity/v3/projects/e25dc93bbbfb49af8d95a6fa55943bd5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:07.346527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.346816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.347364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.375091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:07.375091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:07.438875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1108/2209] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:07.446736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.447308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.447308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.467203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:07.468495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:07.477341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1102/2210] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:07.482282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.493296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8d17a-bc23-4dc9-afdc-c2f3a3848cd7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.498360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.499151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.499490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.499879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.500991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:07.501435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.504069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.523602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1109/2211] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:55:07.528028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.538887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cde-690c-4c8e-a37e-26f052c0196c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.543794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.544532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.544812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.545131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.545824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.547734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.576545 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1103/2212] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:07 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:07.580731 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.592049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe9ed-451b-47be-a728-5a3f3fa32ba9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.677081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.678088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.678383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.678656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.679410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.681633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.715853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1110/2213] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:07 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:07.717055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.728889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08375f4-8975-4cc0-920b-e4a330517066 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.736064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.736794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.737493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.737768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.739104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.744824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.765246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1104/2214] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:07.766449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.777302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbaa73-3af6-49ab-9c1c-d947f877b0a6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.783472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.784413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.784839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.785315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.786483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.788650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd59170-44ee-4318-9c57-c1fe8f51f96f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.804115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1111/2215] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:07.805511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:07.816961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec322b4-55d6-42df-8607-13a2a70727a1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:07.822392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:07.823360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.823633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.823930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] PATH_INFO: `/v3/projects/b3463e29c1f44503a391e1d3bc5e1e4d/users/c8e4a6afd9f84eed8a98fd3b832e9380/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.839156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3463e29c1f44503a391e1d3bc5e1e4d, user_id=c8e4a6afd9f84eed8a98fd3b832e9380, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:07.841835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:07.858730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1105/2216] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:07 2022] PUT /identity/v3/projects/b3463e29c1f44503a391e1d3bc5e1e4d/users/c8e4a6afd9f84eed8a98fd3b832e9380/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:07.872009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:07.872321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:07.872610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:07.927379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] MFA Rules not processed for user `c8e4a6afd9f84eed8a98fd3b832e9380`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:07.930256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:08.011528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1112/2217] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:08.016453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.100890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d490-bb2e-41d7-9766-0e350a91663b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.106120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.106984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.107223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.107499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.108374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.110305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.138438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1106/2218] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:08 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:08.142678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.154526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca84cad-e0e7-41d6-8f71-40bafba7c78d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.214561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.215469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.215686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.216041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.216841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.218936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.242119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1113/2219] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:08 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:08.246130 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.257475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf80a9-e26e-4f1a-9824-6dd34e451b6c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.263689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.264936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.265754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.265950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.266902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.268706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.283570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1107/2220] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:08.288349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.301826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661818-11ed-4580-9747-02a5a3688109 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.314871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.316030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.316360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.316635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] PATH_INFO: `/v3/projects/adb85127d8be49719ad0f05d0ac97703/users/42279284db554c27b1182bfb4b141104/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.336614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb85127d8be49719ad0f05d0ac97703, user_id=42279284db554c27b1182bfb4b141104, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.338787 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.358878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1114/2221] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:08 2022] PUT /identity/v3/projects/adb85127d8be49719ad0f05d0ac97703/users/42279284db554c27b1182bfb4b141104/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:08.363024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.396726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017301-d9c8-472d-a8d6-f56f11e8c0ac admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.495539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.497281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.497783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.498387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.499464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.502087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257da93-de91-4748-b378-f4a5773bd751 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.525669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1108/2222] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:08.528267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.564658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0fc6-3916-489a-bb37-72b1ee108581 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.586307 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.588982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.590381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.590725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] PATH_INFO: `/v3/projects/adb85127d8be49719ad0f05d0ac97703/users/42279284db554c27b1182bfb4b141104/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.594516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb85127d8be49719ad0f05d0ac97703, user_id=42279284db554c27b1182bfb4b141104, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.599034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.624875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1115/2223] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:08 2022] PUT /identity/v3/projects/adb85127d8be49719ad0f05d0ac97703/users/42279284db554c27b1182bfb4b141104/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:08.634953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.635244 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.635523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.664243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] MFA Rules not processed for user `42279284db554c27b1182bfb4b141104`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:08.665445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:08.752330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1109/2224] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:08.782758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:08.784658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:08.849400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b412f7a-99f1-4f97-92ed-c7aa13221900 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:08.853449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:08.854096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:08.854376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:08.854651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:08.864490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:08.866179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e150-a7b7-49e2-af31-64268ddc522c service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:08.875757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1116/2225] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:09.523051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:09.605898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad52c7-ec2f-454a-bd40-c1bf7011a5f8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:09.617280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:09.618492 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:09.618979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:09.619450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] PATH_INFO: `/v3/users/c8e4a6afd9f84eed8a98fd3b832e9380` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:09.622843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e4a6afd9f84eed8a98fd3b832e9380)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:09.625350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:09.692525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e4a6afd9f84eed8a98fd3b832e9380'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:09.693193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e4a6afd9f84eed8a98fd3b832e9380'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:09.697881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e4a6afd9f84eed8a98fd3b832e9380'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:09.716199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e4a6afd9f84eed8a98fd3b832e9380'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:09.726554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e4a6afd9f84eed8a98fd3b832e9380'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:09.761500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1110/2226] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:09 2022] DELETE /identity/v3/users/c8e4a6afd9f84eed8a98fd3b832e9380 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:09.766360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:09.767271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:09.767558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:09.787319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:09.789572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:09.851392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1117/2227] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:09.862253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:09.864129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:09.924991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd741d3d-cbdd-44a6-ac61-fb32bbeb6745 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:09.928961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:09.929726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:09.930006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:09.930277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:09.940486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:09.941976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:09.952127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1111/2228] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:10.258634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:10.260161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:10.276343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff341d-9ad8-4b84-ae80-374347011a4d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:10.296922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:10.299826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:10.300554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:10.300961 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] PATH_INFO: `/v3/projects/b3463e29c1f44503a391e1d3bc5e1e4d` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:10.303647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3463e29c1f44503a391e1d3bc5e1e4d)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:10.308105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:10.428581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3463e29c1f44503a391e1d3bc5e1e4d', 'request_id': 'req-edb09983-5fd3-4f3d-94bd-75121221ddcf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.440827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3463e29c1f44503a391e1d3bc5e1e4d', 'request_id': 'req-edb09983-5fd3-4f3d-94bd-75121221ddcf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.453238 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3463e29c1f44503a391e1d3bc5e1e4d', 'request_id': 'req-edb09983-5fd3-4f3d-94bd-75121221ddcf'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.465372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] The token cache is being invalidate because project b3463e29c1f44503a391e1d3bc5e1e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:10.465735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.466500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.468690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1118/2229] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:10 2022] DELETE /identity/v3/projects/b3463e29c1f44503a391e1d3bc5e1e4d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:10.472969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:10.484919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b12732-c533-4090-b305-75c57d0494e5 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:10.557794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:10.558715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:10.559284 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:10.559796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] PATH_INFO: `/v3/users/42279284db554c27b1182bfb4b141104` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:10.561144 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42279284db554c27b1182bfb4b141104)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:10.563544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:10.627239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42279284db554c27b1182bfb4b141104'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.628110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42279284db554c27b1182bfb4b141104'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.628746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42279284db554c27b1182bfb4b141104'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.652524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42279284db554c27b1182bfb4b141104'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.661358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6f27ce0-f55a-410a-b03b-8da6df93c857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42279284db554c27b1182bfb4b141104'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:10.678752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1112/2230] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:10 2022] DELETE /identity/v3/users/42279284db554c27b1182bfb4b141104 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:11.049951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.051520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:11.064975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09983-5fd3-4f3d-94bd-75121221ddcf admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.123230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.124068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.124348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.124651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] PATH_INFO: `/v3/projects/adb85127d8be49719ad0f05d0ac97703` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.125824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb85127d8be49719ad0f05d0ac97703)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.127747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.175611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb85127d8be49719ad0f05d0ac97703', 'request_id': 'req-fa312c69-22a4-4ff7-97ca-2c616ba199e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:11.181416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb85127d8be49719ad0f05d0ac97703', 'request_id': 'req-fa312c69-22a4-4ff7-97ca-2c616ba199e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:11.189876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb85127d8be49719ad0f05d0ac97703', 'request_id': 'req-fa312c69-22a4-4ff7-97ca-2c616ba199e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:11.201733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] The token cache is being invalidate because project adb85127d8be49719ad0f05d0ac97703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:11.202072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:11.202976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fa312c69-22a4-4ff7-97ca-2c616ba199e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:11.204631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1119/2231] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:11 2022] DELETE /identity/v3/projects/adb85127d8be49719ad0f05d0ac97703 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:11.210058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.210290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.210702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.234202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:11.235445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:11.301523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1113/2232] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:11.309481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.309763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.310058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.328761 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:11.329979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:11.340848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1120/2233] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:11.345282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.356202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71757-78d0-4e0c-902d-4d9e7cbb07f5 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.361439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.362190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.362470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.362728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.363465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:11.363756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.365421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.377924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1114/2234] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:55:11.384120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.396175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888194-67f7-4eb9-9022-49fc1fad10d7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.401951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.402617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.402895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.403165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.403893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.405867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.436915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1121/2235] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:11.440963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.451951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770029-7db9-413c-bd95-28e1f335ff7c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.528109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.528869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.529208 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.529532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.530377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.532546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.554357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1115/2236] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:11.558620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.570206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af2f0-e7f8-4a20-97af-00eea522c217 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.575381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.576153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.576412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.576680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.577429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.579024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.591720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1122/2237] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:55:11.595300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.606529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea970b9-d125-4d98-9437-6b021a8ecccb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.612209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.613219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.613661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.614162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.615110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.617041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d64aa-1d87-44f0-b031-f93bf37f24d8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.628204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1116/2238] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:11.632269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.642326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cd8d2-827d-46e0-a2bf-473991cf76bc admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.647540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.647981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.648262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.648533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] PATH_INFO: `/v3/projects/7fa9ac612f764ec9b3c2a1bfcf3b1092/users/bb2b3a42306f47fcbf5bda0a08b5b230/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.663544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa9ac612f764ec9b3c2a1bfcf3b1092, user_id=bb2b3a42306f47fcbf5bda0a08b5b230, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.666493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.680858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1123/2239] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:11 2022] PUT /identity/v3/projects/7fa9ac612f764ec9b3c2a1bfcf3b1092/users/bb2b3a42306f47fcbf5bda0a08b5b230/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:11.701817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.702099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.702368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.740268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] MFA Rules not processed for user `bb2b3a42306f47fcbf5bda0a08b5b230`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:11.741465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:11.813154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1117/2240] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:11.818834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.897830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7d1a8-49e0-4011-8980-0c27d3ef45f0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:11.903584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:11.904352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:11.904642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:11.905018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:11.905870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:11.907805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:11.935806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1124/2241] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:11.938187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:11.949520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02abbe-e53d-4cd5-a24c-f457108710a1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.019350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.020247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.020527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.020797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.021496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.023419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.045266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1118/2242] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:11 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:12.055571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:12.071228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66f57-178b-42fc-b73d-3c8181af2fd0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.076003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.076928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.077411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.077858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.078802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.080637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.093136 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1125/2243] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:12.097395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:12.108769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31340f1-9511-4f35-8c86-a71f12cfb8d3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.113679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.114707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.115050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.115390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] PATH_INFO: `/v3/projects/b53038c677b34377b77926f6f583b411/users/19e3e4c00dfe4c0b8de6bb1185030680/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.130164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53038c677b34377b77926f6f583b411, user_id=19e3e4c00dfe4c0b8de6bb1185030680, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.133123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.149334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1119/2244] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:12 2022] PUT /identity/v3/projects/b53038c677b34377b77926f6f583b411/users/19e3e4c00dfe4c0b8de6bb1185030680/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:12.154378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:12.165150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df19e-9625-4be4-9196-685c3c30e6de admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.225770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.226436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.226721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.226994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.227712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.229650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea26ae-83ab-4e2c-9738-29b9aeb39fa8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.239689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1126/2245] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:55:12.243923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:12.254922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c6da-150e-4fe8-8e80-c9a8c6ad6259 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.263398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.264403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.264675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.264944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] PATH_INFO: `/v3/projects/b53038c677b34377b77926f6f583b411/users/19e3e4c00dfe4c0b8de6bb1185030680/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.267146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53038c677b34377b77926f6f583b411, user_id=19e3e4c00dfe4c0b8de6bb1185030680, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.269988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.281932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1120/2246] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:12 2022] PUT /identity/v3/projects/b53038c677b34377b77926f6f583b411/users/19e3e4c00dfe4c0b8de6bb1185030680/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:12.292646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.292939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.293216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.318664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] MFA Rules not processed for user `19e3e4c00dfe4c0b8de6bb1185030680`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:12.319900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:12.386157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1127/2247] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:12.399317 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:12.401341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:12.460021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029116d-8980-40e5-b40d-34ab2154031d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:12.464576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:12.465215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:12.465497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:12.465767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:12.527289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:12.528780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62407c3d-0a11-4f5a-88a1-fc8d8fee3066 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:12.538168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1121/2248] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:15.236610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:15.238317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:15.309866 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018204e4-12e4-4488-a538-76ad8d70288e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:15.315089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:15.316008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:15.316265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:15.316531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] PATH_INFO: `/v3/users/2d00238518854d4bbc9e3e1e068e7780` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:15.317876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d00238518854d4bbc9e3e1e068e7780)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:15.319859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:15.371018 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d00238518854d4bbc9e3e1e068e7780'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.379760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d00238518854d4bbc9e3e1e068e7780'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.386648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d00238518854d4bbc9e3e1e068e7780'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.387284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d00238518854d4bbc9e3e1e068e7780'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.388049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d00238518854d4bbc9e3e1e068e7780'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.408699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1128/2249] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:15 2022] DELETE /identity/v3/users/2d00238518854d4bbc9e3e1e068e7780 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:15.413441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:15.413937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:15.414035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:15.431900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:15.433094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:15.496910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1122/2250] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:15.506978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:15.508537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:15.570478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bae4-75d9-4b9a-89d2-0bd9b3258fea admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:15.574818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:15.575464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:15.575739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:15.576042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:15.586596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:15.588112 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408625bf-2dd0-4c34-a3b1-2c0bae9f023a service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:15.604361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1129/2251] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:15.876659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:15.878302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:15.892798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5816cb-5a80-49d2-a9c5-a995ee4995f2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:15.898660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:15.899547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:15.899867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:15.900145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] PATH_INFO: `/v3/projects/b4a4b0ae3b5948808e8b6fa22299a86a` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:15.901495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a4b0ae3b5948808e8b6fa22299a86a)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:15.903439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:15.953075 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a4b0ae3b5948808e8b6fa22299a86a', 'request_id': 'req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.964249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a4b0ae3b5948808e8b6fa22299a86a', 'request_id': 'req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.970514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a4b0ae3b5948808e8b6fa22299a86a', 'request_id': 'req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.982814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] The token cache is being invalidate because project b4a4b0ae3b5948808e8b6fa22299a86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:15.983087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.983807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0a45bb87-a2da-43ee-9d2b-967bd5d0aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:15.988924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1123/2252] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:15 2022] DELETE /identity/v3/projects/b4a4b0ae3b5948808e8b6fa22299a86a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:15.990630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:15.990922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:15.991198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.008727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:16.009964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:16.073856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1130/2253] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:16.082515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.082900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.083184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.103341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:16.104518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:16.114661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1124/2254] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:16.119005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.128421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e2cd-8394-4786-9cd2-d0596b98e501 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.133021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.133668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.133943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.134212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.134925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:16.135230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.136836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.148950 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1131/2255] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:55:16.153066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.163281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931580b-81e4-436d-aad4-3d87569317f7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.169303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.169971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.170250 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.170520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.171214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.173301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.204915 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1125/2256] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:16 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:16.206378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.219569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a1fd-f2e4-4d8d-8b1c-75c506c77bf8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.290072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.291141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.291619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.292042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.292994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.295814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.322278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1132/2257] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:16 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:16.323635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.334994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325aa84-4117-47d1-a5d9-376d35f0eea7 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.340912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.341583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.341860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.342191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.342856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.344569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.358381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1126/2258] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:16.363012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.373643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1573a-8f6e-44b8-953b-b283cf7ce18f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.378749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.379624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.380007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.380397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.381302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.383739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccda96-5c3e-4969-a68a-eafa7b232590 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.398423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1133/2259] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:16.404033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.411471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55edfd-96b1-4caa-b058-8e141edf9edb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.416372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.417266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.417610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.417891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] PATH_INFO: `/v3/projects/0b5f46baaaef48cfb4d9db570253c724/users/f44fbe12bc1a4fce8374cc69b916ad0c/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.434825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5f46baaaef48cfb4d9db570253c724, user_id=f44fbe12bc1a4fce8374cc69b916ad0c, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.437553 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.453137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1127/2260] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:16 2022] PUT /identity/v3/projects/0b5f46baaaef48cfb4d9db570253c724/users/f44fbe12bc1a4fce8374cc69b916ad0c/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:16.463617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.463933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.464211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.490936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] MFA Rules not processed for user `f44fbe12bc1a4fce8374cc69b916ad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:16.492250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:16.560527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1134/2261] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:16.571747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:16.573851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:16.632859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b530f8-ae09-4518-9550-79e022e575d1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:16.636826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:16.637469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:16.637745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:16.638014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:16.647055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:16.648598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:16.658280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1128/2262] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:18.910467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:18.912030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:18.926741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec12d8-0cea-43a1-b031-e5b97e6082e7 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:18.930315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:18.930945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:18.931223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:18.931514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:18.933231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:19.004575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:19.006014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6774-2260-4193-8907-af1f157f30ac service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:19.015185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1135/2263] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:19.666312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:19.667729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:19.744926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac708-c9cf-4f09-ba46-a47a855b8f6d service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:19.749947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:19.751227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:19.751568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:19.751932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] PATH_INFO: `/v3/users/04cd58b2eaa94987b8176577c2673013` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:19.753192 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=04cd58b2eaa94987b8176577c2673013)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:19.755395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:19.840948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04cd58b2eaa94987b8176577c2673013'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:19.842387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04cd58b2eaa94987b8176577c2673013'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:19.843086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04cd58b2eaa94987b8176577c2673013'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:19.857637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04cd58b2eaa94987b8176577c2673013'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:19.867388 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04cd58b2eaa94987b8176577c2673013'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:19.879929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1129/2264] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:19 2022] DELETE /identity/v3/users/04cd58b2eaa94987b8176577c2673013 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:19.884371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:19.884665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:19.884945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:19.903367 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:19.904633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:19.966126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1136/2265] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:19.976097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:19.977520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:20.035663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2dd7-eafc-4502-a30c-205c91548bda admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.039706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.040383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.040657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.040924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.054232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.055870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f9d68-2914-48ea-bc7e-749e7564bc67 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.065860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1130/2266] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:20.484865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.486622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:20.508366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced3f7-5703-459b-9136-e4881d9e5bad None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.513658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.514587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.514868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.515176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] PATH_INFO: `/v3/projects/8b00567be54b4ee598c70999a0c96551` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.516592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b00567be54b4ee598c70999a0c96551)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.519303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.573221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b00567be54b4ee598c70999a0c96551', 'request_id': 'req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:20.581977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b00567be54b4ee598c70999a0c96551', 'request_id': 'req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:20.590886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b00567be54b4ee598c70999a0c96551', 'request_id': 'req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:20.603378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] The token cache is being invalidate because project 8b00567be54b4ee598c70999a0c96551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:20.603809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:20.604475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-0c2118b7-77e7-4c48-bfad-4b4a9b33b2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:20.606651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1137/2267] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:20 2022] DELETE /identity/v3/projects/8b00567be54b4ee598c70999a0c96551 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:20.611885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.612174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.612448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.631323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:20.632542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:20.696147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1131/2268] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:20.705006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.705295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.705573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.724861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:20.726293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:20.735203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1138/2269] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:20.739478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.749944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368959a-0c12-4ff8-b9b3-12b1501e5c34 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.754852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.755512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.755792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.756079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.756819 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:20.757185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.758803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.770193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1132/2270] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:55:20.774629 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.785565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84d51c-4504-42bf-b898-b2cbf0f058e4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.791658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.792395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.792679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.792955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.793645 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.798062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.827016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1139/2271] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:20.831137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.848004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff51f78-58ad-4512-b8c9-30449407fbd4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.906206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.908025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.908307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.908940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.910464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.912704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.935489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1133/2272] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:20 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:20.936607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.947014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ebea-4177-4494-beb7-af6291e75ca7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.952329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.953000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.953280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.953552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.954379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.956053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:20.967813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1140/2273] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:20.971627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:20.982425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b54a7-0a66-48e3-aab4-bcea148e55bd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:20.987173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:20.987991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:20.988403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:20.988649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:20.989394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:20.991053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa613d2c-a13d-4590-b38a-1f6f01a5f322 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:21.005603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1134/2274] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:21.007859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:21.018386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aeaf3-e5fd-44cd-98a2-7b80182928c2 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:21.024418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:21.025366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:21.025651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:21.025928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] PATH_INFO: `/v3/projects/0cffdf9d4af6405dbc203be720191014/users/f8cb9871fdf14a16a12c3d73a951fb61/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:21.041443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cffdf9d4af6405dbc203be720191014, user_id=f8cb9871fdf14a16a12c3d73a951fb61, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:21.044215 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:21.057243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1141/2275] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:21 2022] PUT /identity/v3/projects/0cffdf9d4af6405dbc203be720191014/users/f8cb9871fdf14a16a12c3d73a951fb61/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:21.062393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfbb4-4a93-453b-90c3-ca2b9939dfe6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:21.062800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfbb4-4a93-453b-90c3-ca2b9939dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:21.063144 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfbb4-4a93-453b-90c3-ca2b9939dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:21.081481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4c0dfbb4-4a93-453b-90c3-ca2b9939dfe6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:21.082582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4c0dfbb4-4a93-453b-90c3-ca2b9939dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:21.151412 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1135/2276] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:21.160962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:21.162944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:21.242062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ed35-b598-4136-95a1-32f6c18d0c52 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:21.245803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:21.246496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:21.246888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:21.247186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:21.257438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:21.259024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:21.269550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1142/2277] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:21.925666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3084-5706-4514-8478-16a157666d73 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:21.926207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3084-5706-4514-8478-16a157666d73 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:21.926290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3084-5706-4514-8478-16a157666d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:21.955875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-16ad3084-5706-4514-8478-16a157666d73 None None] MFA Rules not processed for user `f8cb9871fdf14a16a12c3d73a951fb61`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:21.958032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-16ad3084-5706-4514-8478-16a157666d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:22.034554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1136/2278] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:22.045759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:22.047205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:22.117715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15fe6-6ea8-4531-963c-5966e071bd59 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:22.121928 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:22.122572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:22.123061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:22.123338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:22.133939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:22.135389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:22.144643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1143/2279] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:23.528719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845af2-8338-4ae6-897e-9872265ee850 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:23.529172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845af2-8338-4ae6-897e-9872265ee850 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:23.529272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845af2-8338-4ae6-897e-9872265ee850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:23.549136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-88845af2-8338-4ae6-897e-9872265ee850 None None] MFA Rules not processed for user `f8cb9871fdf14a16a12c3d73a951fb61`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:23.550446 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-88845af2-8338-4ae6-897e-9872265ee850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:23.559786 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1137/2280] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:23.981143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:23.982672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:23.996407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113139af-b5da-4d10-8af1-e28fa224f200 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:24.001450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:24.002345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:24.002623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:24.002898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] PATH_INFO: `/v3/users/bb2b3a42306f47fcbf5bda0a08b5b230` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:24.004268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2b3a42306f47fcbf5bda0a08b5b230)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:24.006273 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:24.061177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2b3a42306f47fcbf5bda0a08b5b230'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.070664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2b3a42306f47fcbf5bda0a08b5b230'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.077724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2b3a42306f47fcbf5bda0a08b5b230'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.078377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2b3a42306f47fcbf5bda0a08b5b230'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.079033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2b3a42306f47fcbf5bda0a08b5b230'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.096614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1144/2281] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:23 2022] DELETE /identity/v3/users/bb2b3a42306f47fcbf5bda0a08b5b230 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:24.101196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:24.101569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:24.101926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:24.121119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:24.122608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:24.193186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1138/2282] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:24.202837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:24.204781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:24.260434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ef48-778b-4b77-9ff2-b4d39b501e3d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:24.264217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:24.264871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:24.265155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:24.265431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:24.274782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:24.276265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:24.286527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1145/2283] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:24.563641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:24.565443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:24.580859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e74d-09f5-4868-8313-ebbb7cd448f2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:24.586139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:24.586986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:24.587259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:24.587527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] PATH_INFO: `/v3/projects/7fa9ac612f764ec9b3c2a1bfcf3b1092` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:24.589440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa9ac612f764ec9b3c2a1bfcf3b1092)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:24.591697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:24.643991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa9ac612f764ec9b3c2a1bfcf3b1092', 'request_id': 'req-7d8b5c48-c576-489c-b191-576adb2fb71c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.654067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa9ac612f764ec9b3c2a1bfcf3b1092', 'request_id': 'req-7d8b5c48-c576-489c-b191-576adb2fb71c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.673368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa9ac612f764ec9b3c2a1bfcf3b1092', 'request_id': 'req-7d8b5c48-c576-489c-b191-576adb2fb71c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.687674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] The token cache is being invalidate because project 7fa9ac612f764ec9b3c2a1bfcf3b1092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:24.688146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.688655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.690357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1139/2284] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:24 2022] DELETE /identity/v3/projects/7fa9ac612f764ec9b3c2a1bfcf3b1092 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:24.694560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:24.719918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c9f-7de9-499f-9119-db22a8d1a7e2 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:24.815784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:24.816739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:24.817019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:24.817293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] PATH_INFO: `/v3/users/19e3e4c00dfe4c0b8de6bb1185030680` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:24.818509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e3e4c00dfe4c0b8de6bb1185030680)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:24.820454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:24.866879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e3e4c00dfe4c0b8de6bb1185030680'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.874483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e3e4c00dfe4c0b8de6bb1185030680'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.884253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e3e4c00dfe4c0b8de6bb1185030680'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.884948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e3e4c00dfe4c0b8de6bb1185030680'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.885570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eb7cfb01-efe6-4075-a857-aede9b8d8a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e3e4c00dfe4c0b8de6bb1185030680'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:24.904014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1146/2285] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:24 2022] DELETE /identity/v3/users/19e3e4c00dfe4c0b8de6bb1185030680 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:25.226947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.228825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:25.243006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b5c48-c576-489c-b191-576adb2fb71c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.318184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.319576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.320043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.320470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] PATH_INFO: `/v3/projects/b53038c677b34377b77926f6f583b411` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.323136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53038c677b34377b77926f6f583b411)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.326022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.374648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53038c677b34377b77926f6f583b411', 'request_id': 'req-50be6645-ff97-488f-9bf7-4acca8f59c11'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:25.381631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53038c677b34377b77926f6f583b411', 'request_id': 'req-50be6645-ff97-488f-9bf7-4acca8f59c11'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:25.387363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53038c677b34377b77926f6f583b411', 'request_id': 'req-50be6645-ff97-488f-9bf7-4acca8f59c11'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:25.398226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] The token cache is being invalidate because project b53038c677b34377b77926f6f583b411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:25.398515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:25.399160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-50be6645-ff97-488f-9bf7-4acca8f59c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:25.400724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1140/2286] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:25 2022] DELETE /identity/v3/projects/b53038c677b34377b77926f6f583b411 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:25.406887 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.407391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.407483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.424617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:25.425848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:25.485189 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1147/2287] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:25.494607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.495032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.495315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.516761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:25.518041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:25.527142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1141/2288] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:25.532981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.543264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ded3ab-f74e-4272-9b10-6199d9ce39ab None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.548792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.549486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.549762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.550035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.550870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:25.551173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.553039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.565822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1148/2289] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:55:25.570207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.579552 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a066cc-cefb-41dc-983e-40b3e4a1b286 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.584321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.584981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.585259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.585531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.586228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.588346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.619918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1142/2290] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:25 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:55:25.621169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.631325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12de4-dfc2-457e-b2da-890e4b64b753 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.687556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.688321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.688604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.688879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.689533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.691703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.711579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1149/2291] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:25 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:25.715801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.726488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18f73-7b7a-4390-9af4-d0fee665457b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.732475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.733295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.733533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.733823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.734512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.736355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.747708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1143/2292] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:25.752319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.764299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5dd71-892c-42fd-84a9-12f49ff90d54 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.769988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.770763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.771089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.771370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.772296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.774158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1345ac-0180-4152-a4ce-aa3d7bb91620 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.791207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1150/2293] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:25.793642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:25.805547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55206-e661-4f33-99d8-142598bc5340 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:25.815820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:25.817086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.817086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.817490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] PATH_INFO: `/v3/projects/2d877af1eea64992b7a1914822f11e8e/users/6fbc58fb7df0481f980ec39447b14126/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.834030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d877af1eea64992b7a1914822f11e8e, user_id=6fbc58fb7df0481f980ec39447b14126, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:25.836797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:25.861650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1144/2294] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:25 2022] PUT /identity/v3/projects/2d877af1eea64992b7a1914822f11e8e/users/6fbc58fb7df0481f980ec39447b14126/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:25.873889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:25.874175 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:25.874511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:25.907882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] MFA Rules not processed for user `6fbc58fb7df0481f980ec39447b14126`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:25.909497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:25.981210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1151/2295] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:25.993138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:26.003635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.055563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723c087-dac8-48c9-afbb-9a48431e0973 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:26.059863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:26.060534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.060804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.061045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.070943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:26.072503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3a782-ba52-4f17-878e-9b301a83f5cc service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:26.081747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1145/2296] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:26.101927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:26.166568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43e4f-f13a-4c25-baa1-91de9c8f62ca None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:26.171350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:26.172265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.172560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.172830 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] PATH_INFO: `/v3/users/6fbc58fb7df0481f980ec39447b14126` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.174053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbc58fb7df0481f980ec39447b14126)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:26.176073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:26.224798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbc58fb7df0481f980ec39447b14126'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.233706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbc58fb7df0481f980ec39447b14126'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.240642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbc58fb7df0481f980ec39447b14126'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.241290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbc58fb7df0481f980ec39447b14126'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.241896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbc58fb7df0481f980ec39447b14126'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.261888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1152/2297] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:26 2022] DELETE /identity/v3/users/6fbc58fb7df0481f980ec39447b14126 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:26.266571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.266905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.267187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.285460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:26.287008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.352665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1146/2298] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:26.363474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:26.365021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.420853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef374e8-4aad-4d4b-9eb9-a829ec758057 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:26.424777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:26.425554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.425833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.426104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.435371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:26.436846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370d4ac-3a26-40bc-ab16-6bdd8c65f23a service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:26.446540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1153/2299] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:26.716023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:26.717594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.730457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3da98b-8aea-4a47-a058-827df687ae4c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:26.735909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:26.736806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.737330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.737659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] PATH_INFO: `/v3/projects/2d877af1eea64992b7a1914822f11e8e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.739139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d877af1eea64992b7a1914822f11e8e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:26.741241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:26.788814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d877af1eea64992b7a1914822f11e8e', 'request_id': 'req-27e91bf0-4666-4374-9b07-6dccbc328a80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.799465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d877af1eea64992b7a1914822f11e8e', 'request_id': 'req-27e91bf0-4666-4374-9b07-6dccbc328a80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.811343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d877af1eea64992b7a1914822f11e8e', 'request_id': 'req-27e91bf0-4666-4374-9b07-6dccbc328a80'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.849096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] The token cache is being invalidate because project 2d877af1eea64992b7a1914822f11e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:26.850127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.850617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-27e91bf0-4666-4374-9b07-6dccbc328a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:26.853660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1147/2300] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:26 2022] DELETE /identity/v3/projects/2d877af1eea64992b7a1914822f11e8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:26.860640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.861253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.861602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.880121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:26.881428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.943954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1154/2301] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:26.951963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.952278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.955448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.956328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:26.957729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.969401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8507052-30d7-4496-b0d8-a1eed8337e9c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:26.975026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:26.975415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:26.975956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:26.976387 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:26.976506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] PATH_INFO: `/v3/users/f44fbe12bc1a4fce8374cc69b916ad0c` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:26.976660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:26.978065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44fbe12bc1a4fce8374cc69b916ad0c)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:26.980210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:26.990011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1148/2302] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:26.991065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.001555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb23453-5a3e-4c15-9c89-22ea1384bb0d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.010025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.012223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.012717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.013159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.014098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:27.014577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.016804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.030501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1149/2303] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:55:27.035486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.046794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d4bf-b72e-4c3c-a02f-dffe0d7103c5 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.050185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44fbe12bc1a4fce8374cc69b916ad0c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.056614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.057453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.057729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.058042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.058735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.060708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.061470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44fbe12bc1a4fce8374cc69b916ad0c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.068831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44fbe12bc1a4fce8374cc69b916ad0c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.069495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44fbe12bc1a4fce8374cc69b916ad0c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.070098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-dc912a70-049a-49bc-8899-9fae9eda7b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44fbe12bc1a4fce8374cc69b916ad0c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.087744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1155/2304] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:26 2022] DELETE /identity/v3/users/f44fbe12bc1a4fce8374cc69b916ad0c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:27.091818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1150/2305] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:27 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:27.092028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.092456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.092740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.094565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.097199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.110390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:27.111589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.175358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f939-bb04-4770-9215-0e2157fec640 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.180031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.180789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1156/2306] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:27.180916 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.181123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.181395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.182079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.184054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.190177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.191806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.209617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1151/2307] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:27 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:27.211123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.222395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e38f7-d1bc-4bd5-a111-f0737bcc45a9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.227987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.228654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.228929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.229220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.229970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.231813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.242856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1152/2308] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:27.246316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.258020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8380dc9-879d-4a29-8b74-1d34465cac99 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.262767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.263434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.263708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.264006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.264767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.266297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.268258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc74c12-97cc-43f1-b551-220fd7bf7cc1 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.272155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.272880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.273415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.275287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.281403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1153/2309] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:27.285162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.286308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.287747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7822b9a-1bf3-476e-9918-a87906ed9159 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.296791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5622a5c-1d73-4f0f-aa8b-0172870916eb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.297920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1157/2310] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:55:27.302642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.303534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.303841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.304121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] PATH_INFO: `/v3/projects/c6eeb975ad6b4bf7b006cdf4cd3c91ac/users/b8215705f8654d22bf834b4a6591f546/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.320398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6eeb975ad6b4bf7b006cdf4cd3c91ac, user_id=b8215705f8654d22bf834b4a6591f546, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.323190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.338985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1154/2311] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:27 2022] PUT /identity/v3/projects/c6eeb975ad6b4bf7b006cdf4cd3c91ac/users/b8215705f8654d22bf834b4a6591f546/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:27.350553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.350856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.351116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.393012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] MFA Rules not processed for user `b8215705f8654d22bf834b4a6591f546`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:27.394371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.458316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1158/2312] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:27.469794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.471627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.528820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4764-267f-4975-b254-6d446cfc7251 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.532559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.533175 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.533451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.533722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.542095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.543450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753890-ea05-4143-8793-9037208e88e5 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.553361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1155/2313] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 08:55:27.596952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:27.599375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:27.686838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee515d5-3183-44dc-9653-670fabe77a56 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:27.693986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:27.695790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:27.696299 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:27.696770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] PATH_INFO: `/v3/projects/0b5f46baaaef48cfb4d9db570253c724` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:27.698304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5f46baaaef48cfb4d9db570253c724)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:27.701262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:27.758152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5f46baaaef48cfb4d9db570253c724', 'request_id': 'req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.763190 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5f46baaaef48cfb4d9db570253c724', 'request_id': 'req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.770650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5f46baaaef48cfb4d9db570253c724', 'request_id': 'req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.781967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] The token cache is being invalidate because project 0b5f46baaaef48cfb4d9db570253c724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:27.782251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.783121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:27.784633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1159/2314] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:27 2022] DELETE /identity/v3/projects/0b5f46baaaef48cfb4d9db570253c724 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:33.428155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a7ac-57bc-4de1-9c83-ab01ff28cb2d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:33.428592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a7ac-57bc-4de1-9c83-ab01ff28cb2d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:33.433580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a7ac-57bc-4de1-9c83-ab01ff28cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:33.477037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3fe0a7ac-57bc-4de1-9c83-ab01ff28cb2d None None] MFA Rules not processed for user `f3e7163264a04db9a3b18aea3ae7631b`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:33.479737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3fe0a7ac-57bc-4de1-9c83-ab01ff28cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:33.569649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1156/2315] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:36.097899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:36.099376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:36.218794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db5a4-2ef2-4767-9b61-aea8bf0ff60b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:36.224454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:36.225391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:36.225700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:36.225967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] PATH_INFO: `/v3/users/b8215705f8654d22bf834b4a6591f546` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:36.227479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8215705f8654d22bf834b4a6591f546)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:36.229559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:36.279882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8215705f8654d22bf834b4a6591f546'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:36.287649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8215705f8654d22bf834b4a6591f546'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:36.294700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8215705f8654d22bf834b4a6591f546'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:36.295392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8215705f8654d22bf834b4a6591f546'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:36.296015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8215705f8654d22bf834b4a6591f546'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:36.314262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1160/2316] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:36 2022] DELETE /identity/v3/users/b8215705f8654d22bf834b4a6591f546 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:36.319058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:36.319596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:36.319596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:36.348675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:36.349934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:36.412768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1157/2317] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:36.422672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:36.424094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:36.520760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad88b-477d-4084-8f80-48ad1423484e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:36.524528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:36.525184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:36.525455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:36.525728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:36.535330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:36.536785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2cce5-7217-4423-83e2-375acbd178db service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:36.546769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1161/2318] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:36.985610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:36.987160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:36.999830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88625079-7faf-4c80-8371-1c0ff0a6c922 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.007897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.009089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.009509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.009921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] PATH_INFO: `/v3/projects/c6eeb975ad6b4bf7b006cdf4cd3c91ac` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.011978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6eeb975ad6b4bf7b006cdf4cd3c91ac)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.013914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.087734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6eeb975ad6b4bf7b006cdf4cd3c91ac', 'request_id': 'req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:37.098030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6eeb975ad6b4bf7b006cdf4cd3c91ac', 'request_id': 'req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:37.105705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6eeb975ad6b4bf7b006cdf4cd3c91ac', 'request_id': 'req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:37.119314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] The token cache is being invalidate because project c6eeb975ad6b4bf7b006cdf4cd3c91ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:37.119589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:37.120370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e8a0353a-94d8-44dd-bc9f-d5783a7f41e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:37.121982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1158/2319] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:36 2022] DELETE /identity/v3/projects/c6eeb975ad6b4bf7b006cdf4cd3c91ac => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:37.127512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.128031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.128114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.192575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:37.193776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:37.265286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1162/2320] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:37.274169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.274710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.274710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.296212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:37.297451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:37.310178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1159/2321] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:37.311379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.323400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b8caa-fbd6-4dcd-99e1-6066df612271 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.329955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.330753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.330943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.331220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.331977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:37.332314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.333905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.359391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1163/2322] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:55:37.365013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.387216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce986-72d1-44e6-8256-2f9c11f7d2d1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.402087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.402787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.403204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.403481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.404159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.406612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.462544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1160/2323] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:37 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:37.467824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.481061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85616b35-003f-4d0a-80d5-e157391d404e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.591163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.591898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.592182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.592456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.593211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.597681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.647822 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1164/2324] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:37 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:37.650632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.668193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac706-4b0e-488c-bcc6-395c7682331b admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.682847 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.683603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.683980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.684333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.685125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.686806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.718141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1161/2325] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:37.722532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.735982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a861d-e1d7-4ff1-8e75-523c33aed69e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.743003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.744372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.744804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.745081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.745927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.747759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f103a5-bc3d-444a-91bc-c4b802b3cbae admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.761612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1165/2326] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:37.762867 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:37.774132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521978b1-178f-46d4-8d52-b843e5ddb61a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:37.779760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:37.780985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.781473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.781949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] PATH_INFO: `/v3/projects/f2cd6b015fef41dbbfdb90c67eb15f85/users/d223d82944624ab19b17ea0b189f1af5/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.803379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cd6b015fef41dbbfdb90c67eb15f85, user_id=d223d82944624ab19b17ea0b189f1af5, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:37.807564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:37.825839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1162/2327] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:37 2022] PUT /identity/v3/projects/f2cd6b015fef41dbbfdb90c67eb15f85/users/d223d82944624ab19b17ea0b189f1af5/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:55:37.838420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:37.838715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:37.839133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:37.878473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] MFA Rules not processed for user `d223d82944624ab19b17ea0b189f1af5`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:37.879479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:37.988281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1166/2328] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:38.027433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:38.029661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:38.127728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c957c5-1958-41ee-bfde-4656b08009cd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:38.131418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:38.132122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:38.132401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:38.132672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:38.141842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:38.143285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ed63b-9ce8-4179-b944-a699a8944318 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:38.157493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1163/2329] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:38.171982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:38.294584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bb691-1832-4261-b3e5-a83df24b8c9f None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:38.305947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:38.306848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:38.307130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:38.307404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] PATH_INFO: `/v3/users/d223d82944624ab19b17ea0b189f1af5` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:38.308643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d223d82944624ab19b17ea0b189f1af5)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:38.310687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:38.372119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd223d82944624ab19b17ea0b189f1af5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:38.381690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd223d82944624ab19b17ea0b189f1af5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:38.390809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd223d82944624ab19b17ea0b189f1af5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:38.391535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd223d82944624ab19b17ea0b189f1af5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:38.392193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd223d82944624ab19b17ea0b189f1af5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:38.417317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1167/2330] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:38 2022] DELETE /identity/v3/users/d223d82944624ab19b17ea0b189f1af5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:38.422787 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:38.423704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:38.424145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:38.443123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:38.444383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:38.535336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1164/2331] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:38.545261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:38.546695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:38.607289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b3e0b-4598-4399-aa5c-e4d336e34adf admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:38.611229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:38.611908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:38.612274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:38.612499 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:38.622784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:38.624598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cbd34-f633-4b8a-883a-cd6cb4dca18f service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:38.635922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1168/2332] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:39.124575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.126906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:39.141688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa77a5-cf1c-4d72-8500-f7fcf9fabaa3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.147815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.148910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.149608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.149884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] PATH_INFO: `/v3/projects/f2cd6b015fef41dbbfdb90c67eb15f85` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.151180 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cd6b015fef41dbbfdb90c67eb15f85)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.153323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.231523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cd6b015fef41dbbfdb90c67eb15f85', 'request_id': 'req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:39.242985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cd6b015fef41dbbfdb90c67eb15f85', 'request_id': 'req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:39.249965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cd6b015fef41dbbfdb90c67eb15f85', 'request_id': 'req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:39.262255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] The token cache is being invalidate because project f2cd6b015fef41dbbfdb90c67eb15f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:39.263058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:39.263975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3772f7bc-cd2b-4255-b4ec-98cfa49f8434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:39.265569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1165/2333] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:39 2022] DELETE /identity/v3/projects/f2cd6b015fef41dbbfdb90c67eb15f85 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:39.270656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90007-0b59-4904-89e0-efd43533262a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.271228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90007-0b59-4904-89e0-efd43533262a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.271228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90007-0b59-4904-89e0-efd43533262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.289754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-32a90007-0b59-4904-89e0-efd43533262a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:39.291012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-32a90007-0b59-4904-89e0-efd43533262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:39.368913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1169/2334] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:39.376551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.376839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.377113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.399288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:39.400505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:39.409161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1166/2335] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:39.413832 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a90007-0b59-4904-89e0-efd43533262a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.424500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a90007-0b59-4904-89e0-efd43533262a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.432550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.433236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.433518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.433815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.434552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:55:39.434888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.436710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.449744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1170/2336] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 08:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:55:39.454010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.463426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b19da-1a12-4c02-974f-f5d2d4998558 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.469649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.470340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.470621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.470894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.471636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.474823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.507138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1167/2337] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 08:55:39 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:39.511331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.521772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402bb3-4dd8-4eff-9597-82948ecb79a6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.590469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.591140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.591415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.591684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.592524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.594446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.617011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1171/2338] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 08:55:39 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:55:39.621824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.633028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f62ed6-d05f-4f2b-9f25-4239b8a145f1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.637690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.638366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.638635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.638903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.639625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.641354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.652926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1168/2339] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:55:39.657280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.667258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e65-fcf8-4b04-803b-8e6820a17f3a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.672520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.673195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.673547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.673841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.674741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.676356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04efb5-f13d-49dd-bd90-16db20b32c8f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.692074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1172/2340] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 08:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:55:39.693528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.709624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da25d-bc9e-480c-b87e-ca26b94deec1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.717902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.718975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.719380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.719814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] PATH_INFO: `/v3/projects/2079e95fb98244ea92c8183ce7fead4e/users/82fcf4018f9b443e8714d32cdb48dea0/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.736922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2079e95fb98244ea92c8183ce7fead4e, user_id=82fcf4018f9b443e8714d32cdb48dea0, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.739596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.755597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1169/2341] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 08:55:39 2022] PUT /identity/v3/projects/2079e95fb98244ea92c8183ce7fead4e/users/82fcf4018f9b443e8714d32cdb48dea0/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:39.766436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.766721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.767023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.797150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] MFA Rules not processed for user `82fcf4018f9b443e8714d32cdb48dea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:39.798364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:39.870372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1173/2342] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:39.881945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:39.883806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:39.956956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83bee-47bf-440e-87c5-02b9e21112c3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:39.961511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:39.962473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:39.962917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:39.963332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:39.974078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:39.975556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effaa1-b157-4419-966b-6a0f0b6461e6 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:39.985493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1170/2343] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:40.011688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:40.076816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402ea8-95b1-4fe8-b78d-4530161ff06d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:40.081212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:40.082204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:40.082483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:40.082751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] PATH_INFO: `/v3/users/82fcf4018f9b443e8714d32cdb48dea0` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:40.084246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fcf4018f9b443e8714d32cdb48dea0)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:40.086185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:40.134415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fcf4018f9b443e8714d32cdb48dea0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.142321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fcf4018f9b443e8714d32cdb48dea0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.149355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fcf4018f9b443e8714d32cdb48dea0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.149892 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fcf4018f9b443e8714d32cdb48dea0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.150515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fcf4018f9b443e8714d32cdb48dea0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.173543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1174/2344] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 08:55:40 2022] DELETE /identity/v3/users/82fcf4018f9b443e8714d32cdb48dea0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:40.178233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:40.178475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:40.178772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:40.196182 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:40.197423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:40.264785 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1171/2345] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:55:40.275345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:40.276920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:40.334329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ef998-da1a-4363-a630-b2828371149e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:40.338340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:40.338987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:40.339268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:40.339543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:40.349593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:40.352303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649995a-d926-4d4a-8626-fb26097a6dfe service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:40.368199 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1175/2346] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:40.652406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:40.653908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:40.675033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e0d7a-a9d5-4a08-bc8c-dd1f7ac08972 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:40.680907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:40.681779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:40.682059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:40.682331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] PATH_INFO: `/v3/projects/2079e95fb98244ea92c8183ce7fead4e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:40.683587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2079e95fb98244ea92c8183ce7fead4e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:40.685510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:40.733290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2079e95fb98244ea92c8183ce7fead4e', 'request_id': 'req-c4c0d735-df25-4001-8281-8470db546fe4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.741356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2079e95fb98244ea92c8183ce7fead4e', 'request_id': 'req-c4c0d735-df25-4001-8281-8470db546fe4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.746647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2079e95fb98244ea92c8183ce7fead4e', 'request_id': 'req-c4c0d735-df25-4001-8281-8470db546fe4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.757636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] The token cache is being invalidate because project 2079e95fb98244ea92c8183ce7fead4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 08:55:40.757941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.758677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 08:55:40.760269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1172/2347] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 08:55:40 2022] DELETE /identity/v3/projects/2079e95fb98244ea92c8183ce7fead4e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:55:51.718618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bdd0-167c-4f9d-8c97-727fa7157fc2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:51.719152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bdd0-167c-4f9d-8c97-727fa7157fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:51.719267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bdd0-167c-4f9d-8c97-727fa7157fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:51.737956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b6f7bdd0-167c-4f9d-8c97-727fa7157fc2 None None] MFA Rules not processed for user `e6d1a1b1c3754f0d856df4ca7a8e0269`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:51.739153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b6f7bdd0-167c-4f9d-8c97-727fa7157fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:51.796970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1176/2348] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:56.840570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:56.842064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:56.903807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0d735-df25-4001-8281-8470db546fe4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:56.907949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:56.908656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:56.908932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:56.909205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:56.911060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:56.974642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:56.976121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:56.985840 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1173/2349] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:55:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:55:58.873091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21413d-e51a-4002-af92-080d812c46c5 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:58.873613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21413d-e51a-4002-af92-080d812c46c5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:58.873905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21413d-e51a-4002-af92-080d812c46c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:58.903403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7f21413d-e51a-4002-af92-080d812c46c5 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:55:58.904833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7f21413d-e51a-4002-af92-080d812c46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:58.990262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1177/2350] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:55:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:55:59.046708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:55:59.048270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:55:59.137220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d705-910a-44fb-be04-1123f452fe21 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:55:59.145779 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:55:59.146533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:55:59.146816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:55:59.147162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:55:59.159219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:55:59.161402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404db7-56df-4180-aad6-82b5039f0f9b service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:55:59.192076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1174/2351] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 08:55:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:56:20.020544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.021158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.021158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.022453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1178/2352] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:56:20.028696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3107-b592-42f5-a265-fd3a09b5035b None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.029194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3107-b592-42f5-a265-fd3a09b5035b None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.029414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3107-b592-42f5-a265-fd3a09b5035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.087541 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e0ec3107-b592-42f5-a265-fd3a09b5035b None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:20.088851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e0ec3107-b592-42f5-a265-fd3a09b5035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:20.166542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1175/2353] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 08:56:20.178486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:20.180219 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:20.247110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91969489-a65a-4297-940a-0cb6dfdb7747 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:20.250628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:20.251269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.251552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.251858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.261714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:20.263139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51284d8-2f2d-4aca-8019-afd08d9a8aa1 service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:20.273587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1179/2354] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:56:20.345519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223518e-337f-4a29-852f-66d520e70f97 None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.345856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223518e-337f-4a29-852f-66d520e70f97 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.346125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223518e-337f-4a29-852f-66d520e70f97 None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.347473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1176/2355] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:56:20.353850 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9310ae-7eca-4942-90d2-13d7a9bf6e16 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.354134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9310ae-7eca-4942-90d2-13d7a9bf6e16 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.354404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9310ae-7eca-4942-90d2-13d7a9bf6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.374446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1d9310ae-7eca-4942-90d2-13d7a9bf6e16 None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:20.375667 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1d9310ae-7eca-4942-90d2-13d7a9bf6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:20.382355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1180/2356] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:56:20.394489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223518e-337f-4a29-852f-66d520e70f97 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:20.406455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223518e-337f-4a29-852f-66d520e70f97 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:20.410506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:20.411140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.411417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.411694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.418680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:20.420081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475e6da-2098-488f-bf99-5e40acb408ad service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:20.428409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1177/2357] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:56:20.513985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a633d4-04d6-4404-b4b9-b83bb04f5228 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.514259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a633d4-04d6-4404-b4b9-b83bb04f5228 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.514536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a633d4-04d6-4404-b4b9-b83bb04f5228 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.515993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1181/2358] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 08:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:56:20.521438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97518e-e16f-43ea-a503-da32982b01e5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.521715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97518e-e16f-43ea-a503-da32982b01e5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.521984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97518e-e16f-43ea-a503-da32982b01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.540405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-2e97518e-e16f-43ea-a503-da32982b01e5 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:20.541597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2e97518e-e16f-43ea-a503-da32982b01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:20.552095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1178/2359] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:56:20.562376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a633d4-04d6-4404-b4b9-b83bb04f5228 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:20.573940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a633d4-04d6-4404-b4b9-b83bb04f5228 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:20.577970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:20.578594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:20.578875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:20.579146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:20.589573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:20.591003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:20.602041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1182/2360] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:56:23.651610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:23.652114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:23.652215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:23.702977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:23.704287 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:23.724716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1179/2361] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 08:56:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:56:23.738298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:23.759742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3b2f-97f5-4717-93e7-e256dab4b295 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:23.765352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:23.766274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:23.766556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:23.766834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:23.776027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:23.777648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18682-799f-4997-a599-dd3cc60d4397 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:23.787811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1183/2362] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 08:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:56:38.472076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:38.473647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:38.575306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d9c8e-a388-443c-a08d-8653354624b3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:38.581697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:38.582322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:38.582601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:38.582872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:38.585096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:38.597749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:38.599349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f93698-e95d-441b-8384-76b4460d3448 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:38.610083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1180/2363] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:56:48.217105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:48.217632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:48.217632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:48.240452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] MFA Rules not processed for user `f8cb9871fdf14a16a12c3d73a951fb61`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:48.241720 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:48.299547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1184/2364] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:56:52.862237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240501-1424-4585-be77-002e152016b1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:52.862737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240501-1424-4585-be77-002e152016b1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:52.862842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240501-1424-4585-be77-002e152016b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:52.881309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-54240501-1424-4585-be77-002e152016b1 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:56:52.882504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-54240501-1424-4585-be77-002e152016b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:56:52.890084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1181/2365] 10.222.0.11 () {58 vars in 967 bytes} [Tue May 3 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:56:52.903180 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:56:52.914981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295568e2-6853-42b5-b1d3-389a424dfcfa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:56:52.920427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:56:52.921092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:52.921377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:52.921656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:52.930115 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:56:52.931741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:56:52.940039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1185/2366] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 08:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:58:17.258453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.258985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.258985 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.278991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] MFA Rules not processed for user `e6d1a1b1c3754f0d856df4ca7a8e0269`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:17.280235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:17.291740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1182/2367] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 08:58:36.793143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.794602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:36.807630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e074-052a-4114-98e5-ba9c4295fec5 service swift] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.811838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.812485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.812770 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.813205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.815039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:36.828907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.830328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.841489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1186/2368] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:58:57.979679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.982350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:58.006449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d0969-3e0b-4091-a4ed-6d60a1c46d0f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.013617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.014274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.014555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.014843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.016877 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:58.075824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.077364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.086509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1183/2369] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 08:59:37.260212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:37.269079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f297857-c3e1-4e41-bdf4-6ed5205f5577 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.273708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.274375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.274682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.274964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.276920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:37.287225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.288690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.296864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1187/2370] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 08:59:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:00:02.227428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:02.229152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:02.322233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f463-a4b7-458f-bee3-20486ca7d349 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:02.328460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:02.329415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:02.329804 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:02.330176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:02.333091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:02.406331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:02.407993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:02.416725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1184/2371] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:00:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:00:02.488544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:02.498043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957064-6d0c-4bef-9469-272670e99e9a service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:02.502263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:02.502904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:02.503187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:02.503464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:02.505502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:02.517838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:02.519319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:02.528582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1188/2372] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:00:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:00:03.584535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:03.598275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34979f10-efd7-4718-a986-c53f74140c56 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:03.602582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:03.603247 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:03.603519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:03.603799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:03.605891 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:03.618853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:03.620299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:03.631606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1185/2373] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:00:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:00:06.911520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:06.932996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe748-f2bf-4b45-813f-f95253f725eb service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:06.940386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:06.941021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:06.941301 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:06.941571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:06.943748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:07.010691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:07.013209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:07.028030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1189/2374] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:00:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:00:24.299408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:24.301868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:24.313502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2142-7eff-4c14-acf0-b679497c2c05 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:24.317166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:24.317806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:24.318086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:24.318355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:24.320093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:24.330603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:24.332064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:24.340706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1186/2375] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:00:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:01:41.583746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.598074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ed5d9-92fb-4479-b380-a9976af84680 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.605447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.606093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.606381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.606643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.615642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:41.617312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:41.627264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1190/2376] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:03.009680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:03.018821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782bbb4-7f1b-4d9b-8364-890b63ef7366 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:03.023415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:03.024121 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:03.024400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:03.024668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:03.035533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:03.036993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:03.047909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1187/2377] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:03.176216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:03.177680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:03.198195 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2206a8-8715-4ad6-b409-50efd77e472f service placement] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:03.204017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:03.204589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:03.205054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:03.205486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:03.215523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:03.217123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:03.250427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1191/2378] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:42.262513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:42.272435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114acaa-c8ca-4547-80a6-1986da4dc7c2 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:42.276329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:42.276955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:42.277229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:42.277499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:42.285239 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:42.286669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:42.294880 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1188/2379] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:03.283083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:03.304615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a914f-4425-47e0-8e5b-50d4ffad6c49 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:03.309289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:03.309927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:03.310204 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:03.310480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:03.348393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:03.349839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:03.361067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1192/2380] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:06:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:03.371979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:03.394264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e73a-1211-4e44-a053-9839799fc0d9 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:03.398609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:03.399260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:03.399528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:03.399806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:03.408859 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:03.410438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:03.438112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1189/2381] 10.222.0.11 () {60 vars in 1396 bytes} [Tue May 3 09:06:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:03.486442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:03.495476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ee2f-85bf-490b-9fb7-69cc408ea597 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:03.500455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:03.501102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:03.501380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:03.501651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:03.565611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:03.567047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:03.585987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1193/2382] 10.222.0.11 () {60 vars in 1396 bytes} [Tue May 3 09:06:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:03.632900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:03.645575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a503-aff7-4bb6-9bb4-bfd9b9fc4882 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:03.651712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:03.652389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:03.652669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:03.652946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:03.661050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:03.662622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:03.666244 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:03.674518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a2c10-deba-4f75-bf43-d2b7b729033d service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:03.678408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:03.679046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:03.679326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:03.679598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:03.688224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:03.689643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:03.690109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1190/2383] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:06:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:03.717007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1194/2384] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:06:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:48.563004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:48.564658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:48.695041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7778e1-6448-4faf-9fc1-f647422daacf service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:48.700913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:48.701594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:48.701869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:48.702141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:48.704237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:48.715502 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:48.717205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:48.727095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1191/2385] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:06:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:03.263172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:03.272448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409d3c-7a02-4617-9adc-7a8fe49b46d9 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:03.276621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:03.277259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:03.277532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:03.277796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:03.279909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:03.351400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:03.352851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:03.361935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1195/2386] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:09:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:45.866139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:45.867918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:45.944704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ccc5-a105-4b69-9a80-74323aae983f service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:45.948882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:45.949514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:45.949768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:45.950065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:45.952040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:45.961421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:45.962824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:45.971907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1192/2387] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:09:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:04.108344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:04.110971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.121829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:04.124615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.210393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8aef8-f2c7-464e-9276-cfbb69b46eb9 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:04.214679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:04.215353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:04.215630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:04.215862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced778-d04b-47c2-b35b-275e4387dfa8 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:04.215983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:04.218072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.222779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:04.223421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:04.223697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:04.223999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:04.225862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.255492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:04.257176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:04.267867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1196/2388] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:04.290133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:04.291652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:04.300898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1193/2389] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:04.389934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:04.399601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d62db-16b1-4e3e-8c3a-4a17fbf3c221 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:04.403751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:04.404437 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:04.404716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:04.404992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:04.406948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.482871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:04.484326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:04.493722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1197/2390] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:04.550162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:04.559697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2d30-6088-4b29-98c8-9b0f21c712bc service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:04.563948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:04.564658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:04.564889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:04.565212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:04.567141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:04.639477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:04.640892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:04.650188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1194/2391] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:52.542413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.555004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf406-0a77-46c2-8910-9ddf2568921e service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.561568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:52.562239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.562514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.562783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.571943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:52.573554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:52.584223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1198/2392] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:03.870827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:03.880638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a811a88-b632-4bfa-82a1-91487a870908 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:03.885654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:03.886316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:03.886587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:03.886852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:03.889010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:03.904395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:03.905900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:03.917125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1195/2393] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:12:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:03.451946 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:03.466323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca858ed-e9e9-47cd-9428-d39c14496754 service placement] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:03.473710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:03.474335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:03.474638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:03.474913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:03.484048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:03.485739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:03.513849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1199/2394] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:14:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:25.835427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:25.837157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:25.848558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69de5eb-c061-4491-9c0f-375e4608a2c2 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:25.853225 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:25.853879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:25.854160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:25.854430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:25.856601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:25.948956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:25.951209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:25.980505 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1196/2395] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:26.066040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:26.076662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe056-d0a4-499d-ab1f-0237a1cd0920 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:26.080568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:26.081411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:26.082127 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:26.082404 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:26.084436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:26.098992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:26.100514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:26.112699 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1200/2396] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:14:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:33.400750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.402962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:33.417420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c6d9-14e4-4c58-91c3-2b4420446376 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.426662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.427665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.427991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.428265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] PATH_INFO: `/v3/users/f3e7163264a04db9a3b18aea3ae7631b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.429483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e7163264a04db9a3b18aea3ae7631b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.431474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.480603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e7163264a04db9a3b18aea3ae7631b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.481263 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e7163264a04db9a3b18aea3ae7631b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.481870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e7163264a04db9a3b18aea3ae7631b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.498223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e7163264a04db9a3b18aea3ae7631b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.506243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e7163264a04db9a3b18aea3ae7631b'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.519145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1197/2397] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/users/f3e7163264a04db9a3b18aea3ae7631b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:33.695877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.711600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300a25a-550a-4456-af09-c481550ebb57 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.767458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.768361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.768607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.768873 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] PATH_INFO: `/v3/projects/ffda909ab345414b8962364cf2f5738f` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.770097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffda909ab345414b8962364cf2f5738f)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.772098 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.818425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffda909ab345414b8962364cf2f5738f', 'request_id': 'req-eba674cf-5799-4b5f-952f-c1173a9c1e32'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.823535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffda909ab345414b8962364cf2f5738f', 'request_id': 'req-eba674cf-5799-4b5f-952f-c1173a9c1e32'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.832310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffda909ab345414b8962364cf2f5738f', 'request_id': 'req-eba674cf-5799-4b5f-952f-c1173a9c1e32'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.843996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] The token cache is being invalidate because project ffda909ab345414b8962364cf2f5738f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:33.844669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.845348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.847023 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1201/2398] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/projects/ffda909ab345414b8962364cf2f5738f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:33.853076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.855471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:33.872762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccc3c-f364-412d-8613-8f1a8fd53988 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.930461 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.931349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.931622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.931921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] PATH_INFO: `/v3/users/af873f70f51c4c2eb53c28c0a67d1a54` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.945254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af873f70f51c4c2eb53c28c0a67d1a54)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.947183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.998581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af873f70f51c4c2eb53c28c0a67d1a54'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.999573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af873f70f51c4c2eb53c28c0a67d1a54'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.000598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af873f70f51c4c2eb53c28c0a67d1a54'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.014681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af873f70f51c4c2eb53c28c0a67d1a54'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.023467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af873f70f51c4c2eb53c28c0a67d1a54'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.037485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1198/2399] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/users/af873f70f51c4c2eb53c28c0a67d1a54 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:34.208084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.209602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:34.222806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba674cf-5799-4b5f-952f-c1173a9c1e32 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.282065 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.282934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.283216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.283494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] PATH_INFO: `/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.294424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdd597eaaa4423ca14cb656c5e663e1)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.296486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.342470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdd597eaaa4423ca14cb656c5e663e1', 'request_id': 'req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.349075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdd597eaaa4423ca14cb656c5e663e1', 'request_id': 'req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.357536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdd597eaaa4423ca14cb656c5e663e1', 'request_id': 'req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.369466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] The token cache is being invalidate because project 6cdd597eaaa4423ca14cb656c5e663e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:34.369820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.370544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.372153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1202/2400] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:14:34 2022] DELETE /identity/v3/projects/6cdd597eaaa4423ca14cb656c5e663e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:49.304954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:49.308596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:49.367232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdff34-70ac-45b0-bd09-1b632020882a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:49.414654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:49.415337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:49.415611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:49.415892 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:49.417714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:49.426959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:49.428447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:49.436357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1199/2401] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:03.010465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:03.013034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:03.080982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5e481-fc0f-45d4-bda9-f8e3127c7c67 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:03.085353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:03.085993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:03.086282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:03.086537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:03.088689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:03.146335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:03.147748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:03.156651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1203/2402] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:04.451849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:04.454714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:04.510129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:04.530265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac5f2-e920-44f6-bc1e-ba900191ecea service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:04.535647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:04.536461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:04.536747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:04.537014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:04.539523 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:04.595070 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b848c-6a7d-4df4-9ec4-723a08def113 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:04.601682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:04.602318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:04.602600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:04.602875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:04.604768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:04.623709 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:04.625337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:04.647714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1204/2403] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:16:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:16:04.676554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:04.678128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:04.695923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1200/2404] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:16:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:27.625925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:27.649157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5053a-f459-4170-b296-7082e66d23e4 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:27.655553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:27.656763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.657222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.657863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.660173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:27.674374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:27.676833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:27.690426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1205/2405] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:56.534444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:56.536045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:56.651754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaf6a2-25ee-4982-a1a1-f0593b998985 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:56.660747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:56.661707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:56.662066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:56.662434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:56.665470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:56.677568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:56.679158 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:56.689921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1201/2406] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:16:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:17:04.684285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:04.686162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:04.719486 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d16ec-bf6d-4fc8-8003-6e0f6024cdae service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:04.723278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:04.723951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:04.724233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:04.724500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:04.726351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:04.740764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:04.742243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaecccd-3d0a-4271-adce-a77a7e17a258 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:04.753202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1206/2407] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:17:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:05.115194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:05.118551 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:05.140667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bb77-fc4c-4925-9341-b0130b4b8ba9 service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:05.148800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:05.149477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:05.149746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:05.150023 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:05.151971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:05.164939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:05.166563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:05.178952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1202/2408] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:18:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:07.374440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:07.375040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:07.375040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:07.409141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] MFA Rules not processed for user `65620fcd12544f7094440d60b094cfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:07.410352 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:07.476373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1207/2409] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:18:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:07.801150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:07.813159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d712-7e5d-4563-a6a1-73b6c0260692 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:07.817160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:07.817788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:07.818061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:07.818325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:07.820234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:07.829681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:07.831088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:07.838957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1203/2410] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:08.229376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:08.242458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa728227-d027-42cd-a3a1-97e3bec1719d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:08.248368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:08.249117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:08.249310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:08.249605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:08.251510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:08.264978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:08.266580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:08.278134 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1208/2411] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:16.782413 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:16.797576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92ca9d-72bb-402a-8003-91dc7c895871 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:16.803866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:16.804512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:16.804788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:16.805058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:16.806957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:16.819342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:16.821124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:16.831701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1204/2412] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:18:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:25.410607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:25.425014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846591-670c-44a6-962e-95ed8ee7230d service placement] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:25.430341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:25.430979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:25.431259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:25.431529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:25.434100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:25.448493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:25.454083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:25.472262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1209/2413] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:54.236372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:54.237973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:54.274651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673649d0-f059-41a1-8d79-0d3cb63f7c2d service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:54.278495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:54.279146 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:54.279428 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:54.279700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:54.286745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:54.288224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:54.296127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1205/2414] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:19:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:54.576780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:54.588271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be79ec-e130-46e0-8be1-152f6478c96b service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:54.595631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:54.596319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:54.596571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:54.596861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:54.598920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:54.624248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:54.625886 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:54.634890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1210/2415] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:19:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:21:02.860567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:21:02.876531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4663f-e110-4cc4-b2c7-2411648fbbbe service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:21:02.883379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:21:02.884066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:02.884338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:02.884608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:02.892593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:21:02.894172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:21:02.921934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1206/2416] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:21:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:21:05.379020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:21:05.401383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474ef8-310f-428d-ac0f-3cfb110b4b02 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:21:05.408144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:21:05.408794 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:05.409073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:05.409348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:05.418138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:21:05.419755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:21:05.429537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1211/2417] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:02.515022 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:02.527055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11dab-c3d3-4663-96d6-76c2cc3ae49c service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:02.533463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:02.534103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:02.534377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:02.534643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:02.545649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:02.547267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:02.558021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1207/2418] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:22:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:04.310765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:04.322655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b134fd-05d8-4929-b992-6e582775724e service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:04.326831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:04.327467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:04.327811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:04.328090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:04.339421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:04.340899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94499008-0ace-45c5-ade9-fbd58d44ee97 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:04.352849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1212/2419] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:22:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:05.327443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:05.329028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:05.365179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9a758-9374-4551-a04d-5b56ecff3232 service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:05.369361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:05.370007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:05.370285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:05.370559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:05.379138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:05.380604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:05.389587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1208/2420] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:22:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:29.033071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:29.033655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:29.033655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:29.070931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] MFA Rules not processed for user `027eeadca01b4c4f93b892ef0fbcb195`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:29.072248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:29.079804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1213/2421] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:22:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:39.418115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:39.431109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0942a8-9ff9-4486-bd7c-b5cf01be202d service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:39.437086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:39.437768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:39.438047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:39.438286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:39.448054 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:39.450259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:39.466977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1209/2422] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:22:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:14.174110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:14.187912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc9e09-0cb2-464c-9cd6-5b3db0b09bbd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:14.193783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:14.194427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:14.194719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:14.194976 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:14.209438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:14.212035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:14.235311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1214/2423] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:24:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:25.625603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:25.636099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223b2c-248b-4626-a321-e6b75e29ed7e service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:25.640242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:25.640881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:25.641155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:25.641423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:25.652187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:25.653613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:25.665067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1210/2424] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:56.268907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:56.323055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca59e0-4a3b-45ea-9bed-c9b4214ed20f service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:56.327284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:56.327959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:56.328201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:56.328471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:56.330643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:56.341955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:56.343457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:56.351827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1215/2425] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:03.717628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:03.730191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda2a3-7ec0-4ce9-882c-4739a95abf18 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:03.737480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:03.738120 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:03.738393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:03.738663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:03.740729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:03.812459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:03.814071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:03.823145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1211/2426] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:26:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:05.718757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:05.794642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1846bf-16ac-4f5d-9ff7-442419ed34ed service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:05.799505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:05.800182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:05.800463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:05.800734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:05.802683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:05.890754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:05.892321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:05.912544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1216/2427] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:26:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:06.007105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:06.026215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab76e-8093-48eb-8e6f-f68f863e6121 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:06.030124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:06.030763 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:06.031038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:06.031311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:06.040013 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:06.041452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:06.068104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1212/2428] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:26:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:05.479820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:05.482082 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:05.606532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fd73-3e14-45d2-a056-6cc964b8016f service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:05.612621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:05.613287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:05.613562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:05.613861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:05.615923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:05.627978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:05.629583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:05.641952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1217/2429] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:27:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:02.397548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:02.400471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:02.412988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d6a3a-6437-4436-af94-6fbf4a5df681 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:02.418573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:02.418573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:02.418895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:02.419140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:02.421548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:02.509771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:02.511203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:02.530986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1213/2430] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:02.965419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:02.967896 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:02.981901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ff592-f0fc-4c70-a5d4-13bc223a04e1 service placement] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:02.988395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:02.989409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:02.989778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:02.990081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:03.004579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:03.107484 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:03.108912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:03.119710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1218/2431] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:04.109040 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:04.121050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f0bc-dda5-4c36-b783-8dbdb881ba8c service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:04.128140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:04.129168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:04.129812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:04.130306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:04.133269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:04.236079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:04.248888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9e67d-f601-4eb4-bf36-723bf95fcbcf service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:04.255566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:04.256804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:04.257149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:04.257669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:04.259564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:04.289353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:04.291241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:04.315621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1214/2432] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:04.345806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:04.349126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:04.361621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1219/2433] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:05.223390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:05.226067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:05.245138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bedc7c-0111-456e-999e-0fb64691feda service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:05.252439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:05.253319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:05.253739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:05.254272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:05.258816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:05.282759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:05.284745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:05.300485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1215/2434] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:07.476414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:07.485562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56e3b-7101-48c7-be3a-2dbeae3ca611 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:07.489554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:07.490234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:07.490668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:07.491324 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:07.493393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:07.505659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:07.507447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:07.517890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1220/2435] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:08.524675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:08.527591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:08.544044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b4-dd6e-46f7-b8e7-9da328e9552f service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:08.550422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:08.551951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:08.552390 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:08.552674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] PATH_INFO: `/v3/users/f8cb9871fdf14a16a12c3d73a951fb61` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:08.554820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cb9871fdf14a16a12c3d73a951fb61)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:08.557399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:08.624887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cb9871fdf14a16a12c3d73a951fb61'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:08.626174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cb9871fdf14a16a12c3d73a951fb61'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:08.627184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cb9871fdf14a16a12c3d73a951fb61'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:08.644470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cb9871fdf14a16a12c3d73a951fb61'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:08.655228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b6c54ace-09dd-4baf-85da-330751641776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cb9871fdf14a16a12c3d73a951fb61'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:08.670872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1216/2436] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:08 2022] DELETE /identity/v3/users/f8cb9871fdf14a16a12c3d73a951fb61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:09.162261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.174376 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e028-08a7-4936-a35a-7e3b66753331 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.257279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.258354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.258957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.258957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] PATH_INFO: `/v3/projects/0cffdf9d4af6405dbc203be720191014` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.260213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cffdf9d4af6405dbc203be720191014)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.262415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.335038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cffdf9d4af6405dbc203be720191014', 'request_id': 'req-af901953-4eae-4c5d-b23e-2f40e091f35b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.351883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cffdf9d4af6405dbc203be720191014', 'request_id': 'req-af901953-4eae-4c5d-b23e-2f40e091f35b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.366111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cffdf9d4af6405dbc203be720191014', 'request_id': 'req-af901953-4eae-4c5d-b23e-2f40e091f35b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.398538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] The token cache is being invalidate because project 0cffdf9d4af6405dbc203be720191014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:09.398839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.399751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-af901953-4eae-4c5d-b23e-2f40e091f35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.402272 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1221/2437] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:09 2022] DELETE /identity/v3/projects/0cffdf9d4af6405dbc203be720191014 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:09.408308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.408823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.409301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.528999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:09.530834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.606165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1217/2438] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:09.614229 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.614522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.614808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.638292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:09.640045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.657051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.658453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1222/2439] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:09.672580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7863b-b38b-4149-a07c-1607fbf49eb1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.680559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.681774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.682340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.683453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.685234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:09.690127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.692332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.713873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1218/2440] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:28:09.718223 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.728757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730bce7-8c48-4e3b-a547-92050532418a None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.752613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.753426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.753802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.754135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.754915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.757448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.814373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1223/2441] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:09.819197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.831449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956a01d-35c5-4a37-a836-86a27251b388 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.917522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.918219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.918496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.918765 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.919474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.921451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.960089 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1219/2442] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:09.961821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.983972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a2e65-9163-44d2-913b-0635c8107274 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.989097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.989831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.990111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.990388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.991226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.993341 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.019719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1224/2443] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:10.020887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.036449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bbcd-0b7d-4cd1-b52e-74ae01f83186 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.043470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.045051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.045706 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.046356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.047584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.050685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f803-a41c-4344-853d-d1dde524bb70 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.062950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1220/2444] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:10.067535 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.078491 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4fb5-2bc7-4f79-acf0-c9819d3c68fc admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.085234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.086824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.087312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.089069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] PATH_INFO: `/v3/projects/ee51b7929c5e4bcc845946df0d46f6c6/users/8cc2d7dd95774cb2b0b9c695f222b6cc/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.106813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee51b7929c5e4bcc845946df0d46f6c6, user_id=8cc2d7dd95774cb2b0b9c695f222b6cc, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.109987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.131888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1225/2445] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:10 2022] PUT /identity/v3/projects/ee51b7929c5e4bcc845946df0d46f6c6/users/8cc2d7dd95774cb2b0b9c695f222b6cc/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:10.136191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.136752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.137031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.160454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:10.162106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:10.255980 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1221/2446] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:10.290741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.292530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:10.374002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15d7e7-205b-41c6-b44b-c46ac2c2a604 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.379140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.379870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.380139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.381972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.394864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.397684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.415247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1226/2447] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:11.730459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:11.744473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8314-b503-4fa1-afef-147775678416 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:11.759344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:11.760050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:11.760447 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:11.760588 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:11.762951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:11.787381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:11.789254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:11.819389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1222/2448] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:12.210641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:12.212692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:12.246178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c80c-086b-4444-88e0-8e6ed18e5ed6 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:12.266028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:12.267269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:12.267883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:12.268267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] PATH_INFO: `/v3/users/65620fcd12544f7094440d60b094cfb1` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:12.269834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65620fcd12544f7094440d60b094cfb1)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:12.272130 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:12.355901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65620fcd12544f7094440d60b094cfb1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.372553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65620fcd12544f7094440d60b094cfb1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.383634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65620fcd12544f7094440d60b094cfb1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.385218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65620fcd12544f7094440d60b094cfb1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.386601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65620fcd12544f7094440d60b094cfb1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.433198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1227/2449] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:12 2022] DELETE /identity/v3/users/65620fcd12544f7094440d60b094cfb1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:12.550821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:12.553100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:12.570232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644cba-0d75-4128-b72f-60c3e1d39b96 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:12.663580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:12.664861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:12.665336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:12.665756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] PATH_INFO: `/v3/users/027eeadca01b4c4f93b892ef0fbcb195` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:12.667376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027eeadca01b4c4f93b892ef0fbcb195)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:12.669678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:12.733330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027eeadca01b4c4f93b892ef0fbcb195'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.734686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027eeadca01b4c4f93b892ef0fbcb195'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.735516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027eeadca01b4c4f93b892ef0fbcb195'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.751686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027eeadca01b4c4f93b892ef0fbcb195'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.765084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027eeadca01b4c4f93b892ef0fbcb195'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:12.781392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1223/2450] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:12 2022] DELETE /identity/v3/users/027eeadca01b4c4f93b892ef0fbcb195 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:12.932837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:12.935185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:12.964845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c162c-6d03-4650-a361-3876e3324a1a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.078455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.079504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.079940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.080314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] PATH_INFO: `/v3/projects/fe13f4f312b145cbb904daebc75026d2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.081620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe13f4f312b145cbb904daebc75026d2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.085011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.169617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.171304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:13.193236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fbb5-f546-4925-a54d-1f3f84640fd4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.206145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe13f4f312b145cbb904daebc75026d2', 'request_id': 'req-50584855-5914-460a-8061-b59f5ae69a9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.227425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe13f4f312b145cbb904daebc75026d2', 'request_id': 'req-50584855-5914-460a-8061-b59f5ae69a9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.245150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe13f4f312b145cbb904daebc75026d2', 'request_id': 'req-50584855-5914-460a-8061-b59f5ae69a9f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.276207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] The token cache is being invalidate because project fe13f4f312b145cbb904daebc75026d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:13.276649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.281912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-50584855-5914-460a-8061-b59f5ae69a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.284995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1228/2451] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:12 2022] DELETE /identity/v3/projects/fe13f4f312b145cbb904daebc75026d2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:13.294205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211f80-ff21-466a-9a68-55dfa86aad1a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.294767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211f80-ff21-466a-9a68-55dfa86aad1a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.295186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211f80-ff21-466a-9a68-55dfa86aad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.341337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.342415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.342767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.343104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] PATH_INFO: `/v3/projects/d9159d65c5ca43edadaa60281f20c2ae` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.345464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9159d65c5ca43edadaa60281f20c2ae)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.348409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.353897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b6211f80-ff21-466a-9a68-55dfa86aad1a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:13.355415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b6211f80-ff21-466a-9a68-55dfa86aad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:13.386388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1229/2452] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:13.388446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.388446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.388677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.416032 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9159d65c5ca43edadaa60281f20c2ae', 'request_id': 'req-967db32f-1cbe-4153-ab6d-c464dceed35e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.427523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9159d65c5ca43edadaa60281f20c2ae', 'request_id': 'req-967db32f-1cbe-4153-ab6d-c464dceed35e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.430131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:13.432032 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:13.447227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9159d65c5ca43edadaa60281f20c2ae', 'request_id': 'req-967db32f-1cbe-4153-ab6d-c464dceed35e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.468971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] The token cache is being invalidate because project d9159d65c5ca43edadaa60281f20c2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:13.469560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.470489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-967db32f-1cbe-4153-ab6d-c464dceed35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:13.472935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1224/2453] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:13 2022] DELETE /identity/v3/projects/d9159d65c5ca43edadaa60281f20c2ae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:13.498665 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba940-9cbc-4914-ac3c-33430a94e75a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.499177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba940-9cbc-4914-ac3c-33430a94e75a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.499610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba940-9cbc-4914-ac3c-33430a94e75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.555156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d15ba940-9cbc-4914-ac3c-33430a94e75a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:13.556364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d15ba940-9cbc-4914-ac3c-33430a94e75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:13.564514 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1230/2454] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:13.568059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1225/2455] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:13.569318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.578421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.578421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.579841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.599834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca40c0e-8b1d-4375-b394-a2bf7c8f0b03 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.614057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.614921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.615325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.616960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.617971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:13.620388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.622701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.623042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:13.626060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:13.644233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1226/2456] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:13.648599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.653845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1231/2457] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:28:13.658543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.659257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5c791-785f-4301-9654-037c44fb33ec None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.664821 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.665504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.665775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.666053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.667329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:13.667329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.668841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.686722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1227/2458] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:28:13.687722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.699184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730770ba-7ea5-4f9e-a72c-9668ade22ee7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.703911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c969e9-cc71-46a1-a48d-6de178096f9d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.708581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.710242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.711271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.712157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.713456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.716622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.717476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.718299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.718682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.719057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.721519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.723596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.765060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1228/2459] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:13.769262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.774297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1232/2460] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:13.780028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.848564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50858-f68b-49be-b6c8-217a389be099 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.864457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47ef8c-7339-414e-a747-9d9baba169c5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.876945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.877944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.878386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.878845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.879606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.882239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.907990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1233/2461] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:13.911844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.919259 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.920057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.920393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.920750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.921862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.924079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.927162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea3de-ab14-4611-89d6-2c4e79cff9e0 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.934285 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.936114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.936435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.936831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.937504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.939311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.952997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1234/2462] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:13.955823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1229/2463] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:13 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:13.959381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.959604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:13.975935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1e11-3576-4e66-a09c-464cb51cb437 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.981883 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3904-3299-4f32-aeca-1bed984bc330 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:13.983058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.984207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.985153 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.985587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.987181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.989714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:13.989919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:13.990528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:13.990688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:13.990925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:13.991685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:13.998135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.006184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1230/2464] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:14.010975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.021417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1235/2465] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:14.021809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.034096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a53c5-8961-49d0-9579-688d063815e7 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.038705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84324155-690a-4531-822c-91ff5206ff14 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.042178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.042932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.043219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.043645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.044519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.045132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.046168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.046367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.046568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.047017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] PATH_INFO: `/v3/projects/46e7d2ad2475450c9a38c0b2bffaadd0/users/f48c0c4027e1478f8457726988ebe27c/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.061850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1231/2466] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:14.064228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e7d2ad2475450c9a38c0b2bffaadd0, user_id=f48c0c4027e1478f8457726988ebe27c, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.065675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.067855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26930f-7d8d-43ea-b625-b04e8d0b1093 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.078131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46df5d-43f8-4682-a7b2-4661e6e03f4a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.083634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.084066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.084347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.084618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] PATH_INFO: `/v3/projects/273a7688b38c4558b4c223ba1d9ecdf2/users/0f544c320b724a1fbd779f8ab51a7911/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.089674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1236/2467] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:14 2022] PUT /identity/v3/projects/46e7d2ad2475450c9a38c0b2bffaadd0/users/f48c0c4027e1478f8457726988ebe27c/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:14.099511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.099700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.100015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.113417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273a7688b38c4558b4c223ba1d9ecdf2, user_id=0f544c320b724a1fbd779f8ab51a7911, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.116871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7778b-8ed7-4547-ad6c-921ba0157040 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.138858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1232/2468] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:14 2022] PUT /identity/v3/projects/273a7688b38c4558b4c223ba1d9ecdf2/users/0f544c320b724a1fbd779f8ab51a7911/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:14.142938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] MFA Rules not processed for user `f48c0c4027e1478f8457726988ebe27c`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:14.143636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.143963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.144240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.145348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:14.172386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:14.173729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:14.275905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1237/2469] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:14.281480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.300686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1233/2470] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:14.310099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.313774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:14.382021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b906e-5e19-4f6d-9e78-ec67a00525cb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.389806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.390480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.390765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.391044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.393671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.395641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.407365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6b1b-de13-402e-85ab-fdc48d96dfcc None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.420714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.422066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.430374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.432850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.454110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1238/2471] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:14 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:14.455386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.460969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.462637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.487574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1234/2472] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:28:14.588549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437890a-2f3c-40e3-aeee-176d516d3e67 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.594125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.594931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.595287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.595648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.596512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.598871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.634949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1239/2473] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:14 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:14.636128 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.648172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6419c-a098-4688-84ce-5a47add771a2 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.658993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.660181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.661462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.661965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.663161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.666372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.691019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.696196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1235/2474] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:14.704984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4040e-9c09-4ca2-a6bb-d374069f4dbf admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.710685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.711141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.711433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.711722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] PATH_INFO: `/v3/projects/735427525ebe45db9e2139b47d9571f2/users/6b949d3f2f9d451eb4664621df0fe5f6/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.730294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735427525ebe45db9e2139b47d9571f2, user_id=6b949d3f2f9d451eb4664621df0fe5f6, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.733902 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.756592 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1240/2475] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:14 2022] PUT /identity/v3/projects/735427525ebe45db9e2139b47d9571f2/users/6b949d3f2f9d451eb4664621df0fe5f6/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:14.758270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.771677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0575-3ebf-4c28-936b-5f2e238e6826 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.852124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.853689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.854330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.854794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.855715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.858942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125dc36-b49b-4cb5-a643-9000db6f85ba admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.878722 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1236/2476] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:14.879470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:14.890957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377d90-1834-4c40-8a04-f50b9bb1c074 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:14.896655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:14.898386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.898687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.898973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] PATH_INFO: `/v3/projects/735427525ebe45db9e2139b47d9571f2/users/6b949d3f2f9d451eb4664621df0fe5f6/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.901765 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] RBAC: Authorizing `identity:create_grant(project_id=735427525ebe45db9e2139b47d9571f2, user_id=6b949d3f2f9d451eb4664621df0fe5f6, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:14.905747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:14.934039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1241/2477] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:14 2022] PUT /identity/v3/projects/735427525ebe45db9e2139b47d9571f2/users/6b949d3f2f9d451eb4664621df0fe5f6/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:14.936332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:14.936623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:14.936903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:14.990688 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] MFA Rules not processed for user `6b949d3f2f9d451eb4664621df0fe5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:14.992464 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:15.197236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1237/2478] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:15.213377 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:15.216171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:15.370001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88dd0-dd6e-4200-9f0c-6eff71b4caee admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:15.381735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:15.381735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:15.384524 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:15.384888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:15.404697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:15.406329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:15.419696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1242/2479] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:15.530271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:15.543205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc5155-b354-4cd3-8b46-eb5dfdfa5a00 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:15.549001 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:15.549672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:15.549949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:15.550219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:15.660799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:15.662312 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:15.700848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1238/2480] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:16.839877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:16.844630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:17.017306 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6860a0-3585-4473-9d02-a3d0e91aea5d service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:17.022959 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:17.024185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:17.024857 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:17.025354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] PATH_INFO: `/v3/users/e6d1a1b1c3754f0d856df4ca7a8e0269` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:17.029208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d1a1b1c3754f0d856df4ca7a8e0269)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:17.038220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:17.186631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d1a1b1c3754f0d856df4ca7a8e0269'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.200598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d1a1b1c3754f0d856df4ca7a8e0269'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.215426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d1a1b1c3754f0d856df4ca7a8e0269'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.216522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d1a1b1c3754f0d856df4ca7a8e0269'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.217356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8af92e92-7ccf-44ae-95d1-40275a116527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d1a1b1c3754f0d856df4ca7a8e0269'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.248426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1243/2481] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:16 2022] DELETE /identity/v3/users/e6d1a1b1c3754f0d856df4ca7a8e0269 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:17.572381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:17.598487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a63e-55a1-4447-a88c-a0aa01cc9494 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:17.764568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:17.765567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:17.766519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:17.766860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] PATH_INFO: `/v3/projects/d3ce599e490e457385310fcbca709c84` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:17.768999 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ce599e490e457385310fcbca709c84)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:17.771082 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:17.852672 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ce599e490e457385310fcbca709c84', 'request_id': 'req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.864358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ce599e490e457385310fcbca709c84', 'request_id': 'req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.875514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ce599e490e457385310fcbca709c84', 'request_id': 'req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.901518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] The token cache is being invalidate because project d3ce599e490e457385310fcbca709c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:17.901838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.903151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-8651d5e4-0225-48e5-b0ae-1b5eebbbb330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:17.907720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1239/2482] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:17 2022] DELETE /identity/v3/projects/d3ce599e490e457385310fcbca709c84 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:17.915151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:17.915727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:17.916054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:17.945828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:17.947117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:18.052844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1244/2483] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:18.061090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.061349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.061866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.093756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:18.095162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:18.104129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1240/2484] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:18.108589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.125058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a88a4-12a1-4876-bd61-d8ac65718cfa None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.134943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.135678 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.136230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.136662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.137604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:18.138064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.139999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.157798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1245/2485] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:18.162186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.172149 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5b85-c6d2-4d37-a933-dfc2ab5313be None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.177872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.179012 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.179510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.180177 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.181159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.184255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.239533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1241/2486] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:18 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:18.246298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.260417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160450-0e60-4692-b947-fc4523f94e54 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.342453 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.343685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.344171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.345372 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.346408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.348750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.394532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1246/2487] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:18 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:18.395743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.412784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5b3bf-a759-47d1-9505-932927498e3c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.426385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.427152 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.427427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.427705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.428612 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.431499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.443907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1242/2488] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:18.447718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.466001 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e4d6-ccba-47af-847c-7cc6e8d65506 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.471411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.472364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.473062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.473457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.474820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.477634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11128-db3a-43ca-908b-92c065257d0b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.493287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1247/2489] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:18.497395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.511477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2c2-7d5e-44cc-89b7-29f82f629354 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.516696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.517813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.518084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.518361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] PATH_INFO: `/v3/projects/6dca9c7837bd4a8d8ba8600fd10e2607/users/00039c86985343d3873523584464597c/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.540948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dca9c7837bd4a8d8ba8600fd10e2607, user_id=00039c86985343d3873523584464597c, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.543639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.566411 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1243/2490] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:18 2022] PUT /identity/v3/projects/6dca9c7837bd4a8d8ba8600fd10e2607/users/00039c86985343d3873523584464597c/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:18.579028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.579603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.579983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.612092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] MFA Rules not processed for user `00039c86985343d3873523584464597c`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:18.613588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:18.693618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1248/2491] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:18.701507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:18.703304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:18.786002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025d4da-ba51-4aeb-b420-ba489b9e1b86 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:18.793764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:18.794439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:18.794971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:18.795226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:18.804808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:18.806614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d1acb-b519-4ed8-b93e-c789bf14feb1 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:18.817216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1244/2492] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:19.006652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.008184 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.026884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.027328 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.027515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.068615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] MFA Rules not processed for user `8cc2d7dd95774cb2b0b9c695f222b6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:19.073280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.156689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed713-0159-47fe-84a7-8dff2e4ce383 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.162374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.163681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.164254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.164750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] PATH_INFO: `/v3/users/f48c0c4027e1478f8457726988ebe27c` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.166435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48c0c4027e1478f8457726988ebe27c)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.168923 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.237532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48c0c4027e1478f8457726988ebe27c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:19.247557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1245/2493] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:19.252200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.255046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.257151 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48c0c4027e1478f8457726988ebe27c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:19.267002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48c0c4027e1478f8457726988ebe27c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:19.270984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48c0c4027e1478f8457726988ebe27c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:19.271875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-49623ab3-f814-49a2-b3e5-1351c2890dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48c0c4027e1478f8457726988ebe27c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:19.278224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2df9-5de8-4403-97e9-1ffcdd23c866 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.288882 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.289768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.290047 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.290316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.291015 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.302669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.304335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1249/2494] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:19 2022] DELETE /identity/v3/users/f48c0c4027e1478f8457726988ebe27c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:19.309198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.311312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.311601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.359317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:19.363193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.367898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1246/2495] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:19 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:19.372098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.376598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.484669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c935d96-db10-4727-b364-380afccd061a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.490402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.491176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.491499 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.491940 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.492879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.495006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.505218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1250/2496] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:19.515879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.517363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:19.529681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1247/2497] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:19 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:19.533586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.552437 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ee0f-9dd3-4405-81ee-20f4e2cf63d2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.562488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.563216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.563501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.563795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.564659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.566327 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.587221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1248/2498] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:19.588865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.605454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c45fb-33b2-4348-8f90-0c2e0fb125cb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.612711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.613850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.615607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.615607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] PATH_INFO: `/v3/projects/c3886d294c68464d88dd4a9e97971769/users/7efbb7f73b9b4bc2b8299fad671c9016/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.615919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25fe5c-e087-4bf9-a1cc-d063b8de3796 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.655853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3886d294c68464d88dd4a9e97971769, user_id=7efbb7f73b9b4bc2b8299fad671c9016, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.662134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.696986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1249/2499] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:19 2022] PUT /identity/v3/projects/c3886d294c68464d88dd4a9e97971769/users/7efbb7f73b9b4bc2b8299fad671c9016/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:19.702144 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.712641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.713420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.713775 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.714280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.738603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.742975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.766730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1251/2500] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:28:19.830861 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207031f4-b714-4d26-b964-493f8e23f716 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.839694 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.848397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.850334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.850478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.851966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.853944 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.898246 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1250/2501] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:19.899569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:19.914406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a8cbf-98a9-43cc-bfe4-5a14f199d450 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:19.922906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:19.928037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:19.928513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:19.930110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] PATH_INFO: `/v3/projects/c3886d294c68464d88dd4a9e97971769/users/7efbb7f73b9b4bc2b8299fad671c9016/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:19.933547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3886d294c68464d88dd4a9e97971769, user_id=7efbb7f73b9b4bc2b8299fad671c9016, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:19.941266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:19.974253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1252/2502] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:19 2022] PUT /identity/v3/projects/c3886d294c68464d88dd4a9e97971769/users/7efbb7f73b9b4bc2b8299fad671c9016/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:20.158205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:20.160119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:20.184267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6fe23-f572-4a22-b906-04aad0e40fb9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:20.263207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:20.263827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:20.264249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:20.264535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] PATH_INFO: `/v3/projects/46e7d2ad2475450c9a38c0b2bffaadd0` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:20.267081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e7d2ad2475450c9a38c0b2bffaadd0)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:20.269093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:20.328119 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e7d2ad2475450c9a38c0b2bffaadd0', 'request_id': 'req-4a040817-dfc4-4957-9f19-fc8240c075b2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.353900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e7d2ad2475450c9a38c0b2bffaadd0', 'request_id': 'req-4a040817-dfc4-4957-9f19-fc8240c075b2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.372381 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e7d2ad2475450c9a38c0b2bffaadd0', 'request_id': 'req-4a040817-dfc4-4957-9f19-fc8240c075b2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.405848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] The token cache is being invalidate because project 46e7d2ad2475450c9a38c0b2bffaadd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:20.406726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.408191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.412641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1251/2503] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:20 2022] DELETE /identity/v3/projects/46e7d2ad2475450c9a38c0b2bffaadd0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:20.417413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:20.420505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:20.436064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabe04e-21bb-4ea2-a5e3-2fe281c20aae admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:20.529783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:20.530686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:20.531226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:20.531508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] PATH_INFO: `/v3/users/6b949d3f2f9d451eb4664621df0fe5f6` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:20.532922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b949d3f2f9d451eb4664621df0fe5f6)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:20.535060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:20.635208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b949d3f2f9d451eb4664621df0fe5f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.654470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b949d3f2f9d451eb4664621df0fe5f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.663911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b949d3f2f9d451eb4664621df0fe5f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.666762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b949d3f2f9d451eb4664621df0fe5f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.667445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b949d3f2f9d451eb4664621df0fe5f6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:20.706519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1253/2504] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:20 2022] DELETE /identity/v3/users/6b949d3f2f9d451eb4664621df0fe5f6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:21.733222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:21.747264 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a040817-dfc4-4957-9f19-fc8240c075b2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:21.873802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:21.874745 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:21.875030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:21.875356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] PATH_INFO: `/v3/projects/735427525ebe45db9e2139b47d9571f2` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:21.877984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735427525ebe45db9e2139b47d9571f2)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:21.882136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:21.978044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735427525ebe45db9e2139b47d9571f2', 'request_id': 'req-64672573-6616-4add-90c7-cf4f894206f2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:21.990616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735427525ebe45db9e2139b47d9571f2', 'request_id': 'req-64672573-6616-4add-90c7-cf4f894206f2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.006024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.007646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:22.011686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735427525ebe45db9e2139b47d9571f2', 'request_id': 'req-64672573-6616-4add-90c7-cf4f894206f2'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.034937 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef67d-60ea-42e4-bc0b-c046d3c452bf admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.048358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] The token cache is being invalidate because project 735427525ebe45db9e2139b47d9571f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:22.048655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.052644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-64672573-6616-4add-90c7-cf4f894206f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.062924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1252/2505] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:21 2022] DELETE /identity/v3/projects/735427525ebe45db9e2139b47d9571f2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:22.065548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b7e-fcfb-4cb3-9c24-56b4e8d33def None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.065548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b7e-fcfb-4cb3-9c24-56b4e8d33def None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.065548 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b7e-fcfb-4cb3-9c24-56b4e8d33def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.111652 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-292e1b7e-fcfb-4cb3-9c24-56b4e8d33def None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:22.115886 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-292e1b7e-fcfb-4cb3-9c24-56b4e8d33def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:22.178462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.179382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.179684 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.180015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] PATH_INFO: `/v3/users/00039c86985343d3873523584464597c` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.183529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00039c86985343d3873523584464597c)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.185865 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.289758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1253/2506] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:22.303288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.303613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.304570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.312503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00039c86985343d3873523584464597c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.332263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00039c86985343d3873523584464597c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.348836 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00039c86985343d3873523584464597c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.349576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00039c86985343d3873523584464597c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.350263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-35d2f06f-186e-4e9a-bf77-6b4577a9c4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00039c86985343d3873523584464597c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:22.351689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:22.353017 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:22.373902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1254/2507] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:22.379864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.386052 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1254/2508] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:22 2022] DELETE /identity/v3/users/00039c86985343d3873523584464597c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:22.387833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.388192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.388485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.415721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:22.417158 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:22.417799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bfebe-35fd-4a97-ae61-8fde26244572 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.572028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.572028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.572028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.572028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.577164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:22.577164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.578520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.603759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1255/2509] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:22.609424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1255/2510] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:22.616793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.640528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.643661 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:22.643846 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bf010-ed9f-484f-8b35-49ee2e6e65ac None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.656217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.656894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.657169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.657474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.658123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.660489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.704907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1256/2511] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:22 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:22.708970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.786524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d789d-7881-4a73-a156-1461e0ee446c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.838322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e929d85-634c-46a7-9b0d-ce30d4b0ea50 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.851651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.852503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.852853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.853197 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.853967 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.860733 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.904488 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1257/2512] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:22 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:22.908666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:22.924018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.925310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.926622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.932738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.945542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9fc9-a1ce-4061-a8e8-4686a702f1c7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:22.959654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.959939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:22.961424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:22.961424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:22.961670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:22.962366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:22.963451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.968426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:22.995399 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1256/2514] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:22.995585 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1258/2514] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:22.996667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.016357 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f14de1-4aef-45f9-8b27-c58b67a2b06e service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.030930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.031751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.032097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.032376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.035030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.038401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbddc3f-e86c-4e33-9565-e26bd0ef0522 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.071943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1257/2515] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:23.075807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.092231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3d4a-cdc9-4ada-a507-f2b448a7de72 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.103241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.106384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.110906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.111235 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] PATH_INFO: `/v3/projects/4776c0ee6a37451f8a3f95221c109f57/users/7aa387483e1a45dd8b91e8202a2996c4/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.156295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4776c0ee6a37451f8a3f95221c109f57, user_id=7aa387483e1a45dd8b91e8202a2996c4, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.159111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.206929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1259/2516] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:23 2022] PUT /identity/v3/projects/4776c0ee6a37451f8a3f95221c109f57/users/7aa387483e1a45dd8b91e8202a2996c4/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:23.220690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.220990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.221272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.266768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] MFA Rules not processed for user `7aa387483e1a45dd8b91e8202a2996c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:23.269844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:23.358439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1258/2517] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:23.363017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.467261 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777611f-ca42-48da-bc3b-857cba9234f8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.473342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.474378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.474755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.475178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.476320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.478450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.519102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1260/2518] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:23 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:23.522928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.535140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d427746-4f6e-4175-9924-7c337b4f20c0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.659002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.660025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.660473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.661045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.662561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.664746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.708467 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.716333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1259/2519] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:23 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:23.725818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c9c75-ad68-433f-93cf-a5c3b1ea7f13 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.731898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.733563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.734062 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.734562 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.735536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.739596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.767835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.779452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8910-ad2d-4ecc-a01b-7215352911ad admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:23.780004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1261/2520] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:23.790229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:23.792728 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:23.793836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:23.796058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] PATH_INFO: `/v3/projects/2eee8b18a7914a2299afe5a9a175bea7/users/936a593305744440a198cd2c028ccdbc/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:23.842360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eee8b18a7914a2299afe5a9a175bea7, user_id=936a593305744440a198cd2c028ccdbc, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:23.845750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968935-e98c-4d55-b66a-8b878260a1f5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:23.876695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1260/2521] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:23 2022] PUT /identity/v3/projects/2eee8b18a7914a2299afe5a9a175bea7/users/936a593305744440a198cd2c028ccdbc/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:23.880584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:23.894126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120074f-4df6-4392-802d-87e41c0a7f37 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.025908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.026195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.026766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.076851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.078417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.078947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.083097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.083934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.088363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.111809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1262/2522] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:24.111809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.112811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.126045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] MFA Rules not processed for user `0f544c320b724a1fbd779f8ab51a7911`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:24.127510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.127834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32331f9-45af-4520-a533-97690c8fda54 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.141686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.142586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.143168 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.143648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] PATH_INFO: `/v3/projects/6dca9c7837bd4a8d8ba8600fd10e2607` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.146478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dca9c7837bd4a8d8ba8600fd10e2607)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.148757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.244718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1261/2523] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:24.245729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.258196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dca9c7837bd4a8d8ba8600fd10e2607', 'request_id': 'req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:24.267120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dca9c7837bd4a8d8ba8600fd10e2607', 'request_id': 'req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:24.281315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dca9c7837bd4a8d8ba8600fd10e2607', 'request_id': 'req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:24.282189 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f0bd-27a9-4ae8-a0d7-cb09aa2b03ec None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.305701 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] The token cache is being invalidate because project 6dca9c7837bd4a8d8ba8600fd10e2607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:24.305927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:24.306856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:24.312048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1263/2524] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:24 2022] DELETE /identity/v3/projects/6dca9c7837bd4a8d8ba8600fd10e2607 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:24.312048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.312511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.377692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.378611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.378889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.379336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] PATH_INFO: `/v3/projects/2eee8b18a7914a2299afe5a9a175bea7/users/936a593305744440a198cd2c028ccdbc/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.389434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eee8b18a7914a2299afe5a9a175bea7, user_id=936a593305744440a198cd2c028ccdbc, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.392406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61af74-630d-40ed-984e-4b1228fa1262 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.424559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1262/2525] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:24 2022] PUT /identity/v3/projects/2eee8b18a7914a2299afe5a9a175bea7/users/936a593305744440a198cd2c028ccdbc/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:24.426100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d136-29fd-4b22-871b-6b67caada76e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.426345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d136-29fd-4b22-871b-6b67caada76e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.426622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d136-29fd-4b22-871b-6b67caada76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.458846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-44a1d136-29fd-4b22-871b-6b67caada76e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:24.460662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-44a1d136-29fd-4b22-871b-6b67caada76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.472476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cdebd-0350-4ee5-84df-a5cb522dbcf6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.554759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1263/2526] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:24.556657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.556935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.557408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.596790 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.598211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.598489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.598768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.601129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.603616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] MFA Rules not processed for user `936a593305744440a198cd2c028ccdbc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:24.605136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.677071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.679293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821afe0-45bd-4a4e-8344-c17ecddb6fad service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.719401 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1264/2527] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:24.722837 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.723298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.724094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.762483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:24.768528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.772542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1264/2528] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:24.784658 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1265/2529] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:24.785320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.787318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.789460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.816338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe271067-78cc-4ef5-b7fe-293677c4e1ad None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.823452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.824638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.825529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.826027 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.826998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:24.827557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.835339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.858408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1266/2530] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:24.863055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:24.880834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f6228-724e-497c-b292-58d8adc5cf4a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.887578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.888651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.890965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.891497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.892485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:24.910077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520bad2-ee8e-40b0-b51d-caf08a03c12c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:24.910644 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:24.919518 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:24.920211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:24.920491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:24.920754 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:24.922843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:24.958284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1267/2531] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:24.962152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:25.042919 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:25.044538 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:25.076231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1265/2532] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:28:25.116576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbfdc-c8fe-4e24-9863-6bfebab21677 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:25.129356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:25.131428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:25.131974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:25.132459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:25.133373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:25.136123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:25.198591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:25.200243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1268/2533] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:24 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:25.231746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0767-fd4b-4663-86ae-417b31677e57 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:25.244024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:25.244868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:25.246771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:25.246771 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:25.247557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:25.249406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:25.299660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1266/2534] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:25.303677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:25.327129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587ae9-8dde-4248-8b80-34496c9228da admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:25.349541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:25.352297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:25.352297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:25.352297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:25.353043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:25.355943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1192c-46f5-4374-aadb-1d3a8656e5a0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:25.421612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1269/2535] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:25.426090 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:25.448103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140bba6-e004-4337-866c-a672ef325798 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:25.463775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:25.465035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:25.465322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:25.465592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] PATH_INFO: `/v3/projects/b71ac02087ea456bb0fc1e7455b0f793/users/5283608f904945eebf53a40c4e945d5d/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:25.504671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71ac02087ea456bb0fc1e7455b0f793, user_id=5283608f904945eebf53a40c4e945d5d, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:25.511663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:25.542217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1267/2536] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:25 2022] PUT /identity/v3/projects/b71ac02087ea456bb0fc1e7455b0f793/users/5283608f904945eebf53a40c4e945d5d/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:25.556326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:25.556688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:25.556874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:25.619911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] MFA Rules not processed for user `5283608f904945eebf53a40c4e945d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:25.621159 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:25.896423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1270/2537] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:25.902037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.111258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2569dd-3ef9-4677-a02e-5d5390971299 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.128467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.129393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.129828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.130105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.130808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.133701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.187493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1268/2538] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:25 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:26.192801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.226225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a159faa-c7b2-4eac-9e78-ff9eddd62363 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.327492 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.328359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.328698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.329055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.329869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.332470 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.379141 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1271/2539] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:26 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:26.383093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.423361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc95a4-f3c9-4332-8e47-2e1bafdb0131 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.448223 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.448917 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.449198 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.449458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.450558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.452220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.483037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1269/2540] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:26.484222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.502914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaa0ca-3ca1-443b-ae77-e81e4184b1d5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.509921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.511192 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.511569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.512017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] PATH_INFO: `/v3/projects/c37a483058d74fef89195627c18004a9/users/81dfb453ec8d47b5aa36dcbc01ddbeba/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.552368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37a483058d74fef89195627c18004a9, user_id=81dfb453ec8d47b5aa36dcbc01ddbeba, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.560786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.594689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1272/2541] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:26 2022] PUT /identity/v3/projects/c37a483058d74fef89195627c18004a9/users/81dfb453ec8d47b5aa36dcbc01ddbeba/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:26.598434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.615961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e65bc-1553-49da-8fea-b21a9b175f98 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.732132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.732830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.733107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.733377 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.734422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.737322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddff76d-1c51-458e-8e5f-28d308d490da admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.762040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:26.769587 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1270/2542] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:26.774649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781684-dbe9-4beb-8f38-d38166f73116 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:26.780879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:26.782369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.782817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.783280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] PATH_INFO: `/v3/projects/c37a483058d74fef89195627c18004a9/users/81dfb453ec8d47b5aa36dcbc01ddbeba/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.786438 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37a483058d74fef89195627c18004a9, user_id=81dfb453ec8d47b5aa36dcbc01ddbeba, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:26.793320 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:26.814369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1273/2543] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:26 2022] PUT /identity/v3/projects/c37a483058d74fef89195627c18004a9/users/81dfb453ec8d47b5aa36dcbc01ddbeba/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:26.817465 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:26.817972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:26.818423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:26.880871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] MFA Rules not processed for user `81dfb453ec8d47b5aa36dcbc01ddbeba`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:26.882186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:27.042932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1271/2544] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:27.051441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:27.185293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde351-1f60-4d32-aa97-838c2d1ad801 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:27.197921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:27.198660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:27.198810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:27.199531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:27.228064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:27.230265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbf9eb-f7d7-43cd-bc40-4dfd6fa73205 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:27.244397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1274/2545] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:27.538670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:27.738895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83949-248e-498d-96f0-f1267154de8e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:27.751102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:27.752654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:27.752654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:27.753238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] PATH_INFO: `/v3/users/5283608f904945eebf53a40c4e945d5d` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:27.754748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5283608f904945eebf53a40c4e945d5d)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:27.757575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:27.844607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5283608f904945eebf53a40c4e945d5d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:27.845909 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5283608f904945eebf53a40c4e945d5d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:27.846563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5283608f904945eebf53a40c4e945d5d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:27.861041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5283608f904945eebf53a40c4e945d5d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:27.874826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5283608f904945eebf53a40c4e945d5d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:27.910731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1272/2546] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:27 2022] DELETE /identity/v3/users/5283608f904945eebf53a40c4e945d5d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:27.913281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c443-fbc8-47cc-8499-400084e4a4db None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:27.913567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c443-fbc8-47cc-8499-400084e4a4db None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:27.913843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c443-fbc8-47cc-8499-400084e4a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:27.943654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8843c443-fbc8-47cc-8499-400084e4a4db None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:27.944605 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8843c443-fbc8-47cc-8499-400084e4a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.019746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1275/2547] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:28.057818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:28.060115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.179999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:28.180715 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:28.180942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:28.226062 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c457c-e613-4532-9ae8-bbf222499b72 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:28.230843 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] MFA Rules not processed for user `0f544c320b724a1fbd779f8ab51a7911`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:28.232107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.242117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:28.242981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:28.243349 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:28.243679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:28.255278 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:28.257427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd921be-e5df-4ca5-a1b4-f0d94323d5da service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:28.273680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1273/2548] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:28.313283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1276/2549] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:28.706193 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:28.706678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:28.706768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:28.758611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] MFA Rules not processed for user `7efbb7f73b9b4bc2b8299fad671c9016`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:28.760049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.837844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:28.839384 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.866746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f7b3d-e8d0-4654-8177-ef559be6aed4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:28.881473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:28.882996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:28.883284 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:28.883559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:28.889839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.907818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:28.909989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:28.926526 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1274/2550] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:28.928557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:28.931905 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.938511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1277/2551] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:28.947534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:28.949193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.984265 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482c4a-e501-4270-b600-fed85f450331 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:28.999631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:29.000622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.000912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.001187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] PATH_INFO: `/v3/projects/b71ac02087ea456bb0fc1e7455b0f793` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.004445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71ac02087ea456bb0fc1e7455b0f793)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:29.006468 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:29.101112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71ac02087ea456bb0fc1e7455b0f793', 'request_id': 'req-85f75962-66df-421e-ba34-955ba9f45622'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.116995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71ac02087ea456bb0fc1e7455b0f793', 'request_id': 'req-85f75962-66df-421e-ba34-955ba9f45622'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.128698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71ac02087ea456bb0fc1e7455b0f793', 'request_id': 'req-85f75962-66df-421e-ba34-955ba9f45622'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.151384 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] The token cache is being invalidate because project b71ac02087ea456bb0fc1e7455b0f793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:29.151855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.152638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.153078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eed155-ec3f-4a64-9701-b4b430457be8 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:29.154808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1275/2552] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:28 2022] DELETE /identity/v3/projects/b71ac02087ea456bb0fc1e7455b0f793 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:29.159707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:29.161205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:29.276958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:29.278295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.278764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.279218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.281708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:29.322405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75962-66df-421e-ba34-955ba9f45622 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:29.328647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:29.329881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.330404 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.330935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] PATH_INFO: `/v3/users/81dfb453ec8d47b5aa36dcbc01ddbeba` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.332623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dfb453ec8d47b5aa36dcbc01ddbeba)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:29.344789 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:29.362516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:29.364551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ad8d1-a512-4a61-81d2-f51b2cd425b8 service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:29.377521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1278/2553] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:29.454724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dfb453ec8d47b5aa36dcbc01ddbeba'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.459125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dfb453ec8d47b5aa36dcbc01ddbeba'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.460371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dfb453ec8d47b5aa36dcbc01ddbeba'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.509506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dfb453ec8d47b5aa36dcbc01ddbeba'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.521003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dfb453ec8d47b5aa36dcbc01ddbeba'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:29.544109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1276/2554] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:29 2022] DELETE /identity/v3/users/81dfb453ec8d47b5aa36dcbc01ddbeba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:29.563609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.564198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.564688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.650552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:29.652154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:29.751968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1279/2555] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:29.803288 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:29.805629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:29.846026 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:29.847601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:29.943485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dac6e-aeec-43eb-b6cd-8e276fe016e1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:29.949197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:29.951170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.951454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.952068 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.963606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:29.964142 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0becc-b25d-4909-b349-a556be7e5a33 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:29.965433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e7adb-34c7-4bf7-8edf-3b4216c8ad75 service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:29.969510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:29.970359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:29.970643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:29.970908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] PATH_INFO: `/v3/projects/c37a483058d74fef89195627c18004a9` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:29.972278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37a483058d74fef89195627c18004a9)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:29.974224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:29.982020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1277/2556] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:28:30.052489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37a483058d74fef89195627c18004a9', 'request_id': 'req-d325a87d-97bb-4ad6-8618-a0ff4045cf85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:30.060868 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37a483058d74fef89195627c18004a9', 'request_id': 'req-d325a87d-97bb-4ad6-8618-a0ff4045cf85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:30.073989 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37a483058d74fef89195627c18004a9', 'request_id': 'req-d325a87d-97bb-4ad6-8618-a0ff4045cf85'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:30.090198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] The token cache is being invalidate because project c37a483058d74fef89195627c18004a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:30.090487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:30.091314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-d325a87d-97bb-4ad6-8618-a0ff4045cf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:30.093099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1280/2557] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:29 2022] DELETE /identity/v3/projects/c37a483058d74fef89195627c18004a9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:30.099592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.100143 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.100418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.124471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:30.126060 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.201704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1278/2558] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:30.209673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.209966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.210230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.235498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:30.236745 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.248922 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1281/2559] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:30.253313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.264091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07664c5-4856-4708-91fd-bf6048e552f9 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.270519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.271304 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.271647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.272162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.273043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:30.273525 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.275134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.289033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1279/2560] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:30.293650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.306806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377115-c840-4305-8cfc-9dfa06fda149 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.311856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.312586 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.313054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.313639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.314544 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.316859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.352348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1282/2561] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:30.356889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.368363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfef7b6-d13e-4bb8-9b99-a046f5e4b3fc admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.439788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.440646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.440931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.441205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.442057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.444470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.468935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1280/2562] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:30.473007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.485814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9f-646f-46a9-9146-50b0fdbcf5ee admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.490717 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.491390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.491692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.492007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.492739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.494333 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.506268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1283/2563] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:30.510395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.521376 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020c7b-7b2a-4269-a9b1-76ebc3107d2e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.526885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.527606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.527968 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.528254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.529039 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.530846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.550773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1281/2564] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:30.552075 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.562785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2037-604d-4ded-8411-c0400ac68ed9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.569342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.570246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.570546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.570789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] PATH_INFO: `/v3/projects/1c66e91ccb034f6fb36013ecb3a9b6ed/users/614b00961a6b4d318f32561a59fb9291/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.595788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c66e91ccb034f6fb36013ecb3a9b6ed, user_id=614b00961a6b4d318f32561a59fb9291, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.599998 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642074f-7362-45d0-9786-a929e4757a79 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.619554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1284/2565] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:30 2022] PUT /identity/v3/projects/1c66e91ccb034f6fb36013ecb3a9b6ed/users/614b00961a6b4d318f32561a59fb9291/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:30.628043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.630140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.632254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.632834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.633314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.662181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] MFA Rules not processed for user `614b00961a6b4d318f32561a59fb9291`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:30.663426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.746476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67f7a-c5b2-426b-b624-1f21983657c9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.768464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1285/2566] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:30.772566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.834834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.835532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.835831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.836104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.838972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.862283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.863955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.877080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c760c83-88bc-4ab3-ba63-ddcb872f1e0d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:30.879825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1282/2567] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:30.910328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:30.911011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:30.911294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:30.911617 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:30.915468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:30.922551 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:30.956423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:30.957959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:30.981472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1286/2568] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:30.986613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.125791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748426a3-f896-490a-8838-c9ba2ab91d97 service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.159943 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a84-02d4-4d3b-9882-6e7c589842e5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.166021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.166795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.171588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.172107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.172918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.175818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.215452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.216347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.216626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.216928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.218837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:31.219185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1287/2569] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:30 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:31.223220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.252097 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c083d5-2474-4f7f-92f4-99ecbe206a10 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.263616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.264416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.265465 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.265831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.268889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.270664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.299671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1288/2570] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:31.303448 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.312594 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.314290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.328148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1283/2571] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:31.350662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c20aa-9be6-46d5-a0a6-612255af3384 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.356711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.357409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.357697 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.357974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.358716 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.360414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07141c-43c0-4791-b74d-91c79b87bf33 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.380510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1289/2572] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:31.384515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.403351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431917-e433-45a2-ae89-96bae162fc57 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.421467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.422482 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.422752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.423026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] PATH_INFO: `/v3/projects/71b0fbc67bd24b4f8e06f630936ec0c5/users/d30f99d19b7b4947a91bcf9d70ccb03d/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.453371 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b0fbc67bd24b4f8e06f630936ec0c5, user_id=d30f99d19b7b4947a91bcf9d70ccb03d, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.456959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.477019 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1284/2573] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:31 2022] PUT /identity/v3/projects/71b0fbc67bd24b4f8e06f630936ec0c5/users/d30f99d19b7b4947a91bcf9d70ccb03d/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:31.492114 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.492409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.492692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.529198 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] MFA Rules not processed for user `d30f99d19b7b4947a91bcf9d70ccb03d`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:31.530649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:31.654532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1290/2574] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:31.655251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.818336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84f4e0-2ce6-4e0c-be0b-cfcb430019ff admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:31.834848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:31.835798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:31.836091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:31.836367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:31.838644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:31.841834 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:31.926529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1285/2575] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:31 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:31.930633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:31.945345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c8af0-b394-4ed6-833e-6397173bf76e None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.031107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.032441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.032817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.033260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.034503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.037178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.068380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1291/2576] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:31 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:32.072593 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.085634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19d6b1-b6a3-491e-900a-e5b93aea50e6 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.091972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.092633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.092914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.093186 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.093926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.095577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.108632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1286/2577] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:32.113057 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.124391 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ecc2-7c23-4a2a-b157-1647788fdc9c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.132482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.133541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.133810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.134087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] PATH_INFO: `/v3/projects/afac4fdbb87e4b94bb305a5301509e4a/users/c3d5c9aacdac45e4b5cf80c194433327/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.152044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=afac4fdbb87e4b94bb305a5301509e4a, user_id=c3d5c9aacdac45e4b5cf80c194433327, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.154816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.171891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1292/2578] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:32 2022] PUT /identity/v3/projects/afac4fdbb87e4b94bb305a5301509e4a/users/c3d5c9aacdac45e4b5cf80c194433327/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:32.175993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.186248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516814d-2675-411d-802d-6336c45dc1b9 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.276383 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.277170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.277607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.278237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.278975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.280918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2125f-d24c-4bdc-a1af-5778ad018983 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.295028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1287/2579] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:32.299621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.311914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765f64-a4be-401e-8644-82af2ec98dcd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.322849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.324208 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.324844 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.325126 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] PATH_INFO: `/v3/projects/afac4fdbb87e4b94bb305a5301509e4a/users/c3d5c9aacdac45e4b5cf80c194433327/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.330815 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afac4fdbb87e4b94bb305a5301509e4a, user_id=c3d5c9aacdac45e4b5cf80c194433327, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.337131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.350461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1293/2580] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:32 2022] PUT /identity/v3/projects/afac4fdbb87e4b94bb305a5301509e4a/users/c3d5c9aacdac45e4b5cf80c194433327/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:32.361685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.362004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.362307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.398059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] MFA Rules not processed for user `c3d5c9aacdac45e4b5cf80c194433327`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:32.406869 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:32.504936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1288/2581] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:32.517970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.598648 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee24a11-df00-436f-9e58-ad3b85619584 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.606960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.607668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.608000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.608286 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.689037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.691037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.709243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1294/2582] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:28:35.580046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:35.582237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:35.603736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb1f71-39f2-4bef-b01a-2b9acebfde1d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:35.610848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:35.613433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:35.613912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:35.614339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:35.739719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:35.745711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b3c9-3303-4d5b-9113-53e51b6758ae service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:35.766449 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1289/2583] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:37.091516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:37.103313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be3de-2125-4a02-8bdf-f7bf7585eeaf service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:37.111559 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:37.112328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:37.113742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:37.115369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:37.145033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:37.146947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:37.163068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1295/2584] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:41.465865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:41.466451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:41.466451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:41.485647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] MFA Rules not processed for user `8cc2d7dd95774cb2b0b9c695f222b6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:41.486978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:41.544393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1290/2585] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:41.831679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:41.833497 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:41.892903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f4673-55a8-4fda-9c74-7fd32d5c9ba7 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:41.898005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:41.899160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:41.899694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:41.900411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:41.903510 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:41.917363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:41.919392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8570a6c-d45f-4bca-81af-897043db0158 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:41.929730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1296/2586] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:43.315753 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:43.392705 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b9e8-ea1e-4a3c-aa9b-8fa830bc705a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:43.398908 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:43.400476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:43.400747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:43.401006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] PATH_INFO: `/v3/users/614b00961a6b4d318f32561a59fb9291` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:43.402294 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614b00961a6b4d318f32561a59fb9291)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:43.404228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:43.455123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614b00961a6b4d318f32561a59fb9291'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:43.455807 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614b00961a6b4d318f32561a59fb9291'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:43.456439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614b00961a6b4d318f32561a59fb9291'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:43.468125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614b00961a6b4d318f32561a59fb9291'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:43.476228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614b00961a6b4d318f32561a59fb9291'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:43.490720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1291/2587] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:43 2022] DELETE /identity/v3/users/614b00961a6b4d318f32561a59fb9291 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:43.497315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:43.497853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:43.497853 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:43.522926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:43.524402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:43.602428 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1297/2588] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:43.612514 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:43.614257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:43.671837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdf6f-5052-465a-afbe-b9429bc74af1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:43.676650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:43.677469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:43.677792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:43.678096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:43.690811 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:43.693014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:43.703529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1292/2589] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:43.989187 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:43.991289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:44.017037 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85343-dcd3-4da1-a912-b38c4fc17152 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:44.022685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:44.023638 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:44.023952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:44.025009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] PATH_INFO: `/v3/projects/1c66e91ccb034f6fb36013ecb3a9b6ed` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:44.026305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c66e91ccb034f6fb36013ecb3a9b6ed)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:44.028402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:44.088589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c66e91ccb034f6fb36013ecb3a9b6ed', 'request_id': 'req-e9be0655-bd66-4335-89d7-a15cd865b57c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.094326 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c66e91ccb034f6fb36013ecb3a9b6ed', 'request_id': 'req-e9be0655-bd66-4335-89d7-a15cd865b57c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.102212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c66e91ccb034f6fb36013ecb3a9b6ed', 'request_id': 'req-e9be0655-bd66-4335-89d7-a15cd865b57c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.113686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] The token cache is being invalidate because project 1c66e91ccb034f6fb36013ecb3a9b6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:44.113969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.114594 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.116179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1298/2590] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:43 2022] DELETE /identity/v3/projects/1c66e91ccb034f6fb36013ecb3a9b6ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:44.121997 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:44.132671 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e64d-ae73-410a-8fb7-b02322947ff2 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:44.193275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:44.194212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:44.194495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:44.194767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] PATH_INFO: `/v3/users/d30f99d19b7b4947a91bcf9d70ccb03d` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:44.196234 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30f99d19b7b4947a91bcf9d70ccb03d)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:44.198249 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:44.255272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30f99d19b7b4947a91bcf9d70ccb03d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.255902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30f99d19b7b4947a91bcf9d70ccb03d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.256508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30f99d19b7b4947a91bcf9d70ccb03d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.268115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30f99d19b7b4947a91bcf9d70ccb03d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.277029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30f99d19b7b4947a91bcf9d70ccb03d'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.290889 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1293/2591] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:44 2022] DELETE /identity/v3/users/d30f99d19b7b4947a91bcf9d70ccb03d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:44.581582 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:44.583249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:44.607979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0655-bd66-4335-89d7-a15cd865b57c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:44.684193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:44.685140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:44.685416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:44.685811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] PATH_INFO: `/v3/projects/71b0fbc67bd24b4f8e06f630936ec0c5` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:44.686994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b0fbc67bd24b4f8e06f630936ec0c5)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:44.688981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:44.737124 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b0fbc67bd24b4f8e06f630936ec0c5', 'request_id': 'req-37995c68-60db-4b88-afc3-a91fdd0b9ed2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.743464 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b0fbc67bd24b4f8e06f630936ec0c5', 'request_id': 'req-37995c68-60db-4b88-afc3-a91fdd0b9ed2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.753964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b0fbc67bd24b4f8e06f630936ec0c5', 'request_id': 'req-37995c68-60db-4b88-afc3-a91fdd0b9ed2'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.765419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] The token cache is being invalidate because project 71b0fbc67bd24b4f8e06f630936ec0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:44.765704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.766316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.767918 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1299/2592] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:44 2022] DELETE /identity/v3/projects/71b0fbc67bd24b4f8e06f630936ec0c5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:44.772132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:44.773640 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:44.786638 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8cc3d-7b94-43c5-a981-3653e392dac3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:44.846713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:44.847639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:44.847945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:44.848220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] PATH_INFO: `/v3/users/c3d5c9aacdac45e4b5cf80c194433327` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:44.849426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d5c9aacdac45e4b5cf80c194433327)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:44.851485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:44.899902 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d5c9aacdac45e4b5cf80c194433327'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.900583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d5c9aacdac45e4b5cf80c194433327'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.901203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d5c9aacdac45e4b5cf80c194433327'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.913365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d5c9aacdac45e4b5cf80c194433327'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.923568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-831a1872-2c97-4f8a-9f74-430f98124854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d5c9aacdac45e4b5cf80c194433327'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:44.936801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1294/2593] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:44 2022] DELETE /identity/v3/users/c3d5c9aacdac45e4b5cf80c194433327 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:45.234861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.236584 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:45.251165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37995c68-60db-4b88-afc3-a91fdd0b9ed2 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.314654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.315554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.315859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.316135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] PATH_INFO: `/v3/projects/afac4fdbb87e4b94bb305a5301509e4a` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.317349 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afac4fdbb87e4b94bb305a5301509e4a)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.319267 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.366365 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afac4fdbb87e4b94bb305a5301509e4a', 'request_id': 'req-30a413f6-6230-4d93-b262-a214611e37a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:45.371744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afac4fdbb87e4b94bb305a5301509e4a', 'request_id': 'req-30a413f6-6230-4d93-b262-a214611e37a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:45.381165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afac4fdbb87e4b94bb305a5301509e4a', 'request_id': 'req-30a413f6-6230-4d93-b262-a214611e37a0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:45.392560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] The token cache is being invalidate because project afac4fdbb87e4b94bb305a5301509e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:45.392847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:45.393579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-30a413f6-6230-4d93-b262-a214611e37a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:45.395263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1300/2594] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:45 2022] DELETE /identity/v3/projects/afac4fdbb87e4b94bb305a5301509e4a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:45.400707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.400995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.401272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.420539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:45.421793 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:45.490102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1295/2595] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:45.549713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.549949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.550388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.576431 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:45.577654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:45.587506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1301/2596] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:45.592531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.604045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e1d3-10d4-4d42-8b54-fc2a3c9af065 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.609397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.610056 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.610332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.610607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.611345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:45.611653 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.613339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.625479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1296/2597] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:45.630451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.640960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0f98-e609-490f-9a8d-2beea6beedcb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.647650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.648363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.648647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.649265 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.649650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.651578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.679652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1302/2598] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:45.684209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.695493 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762a1d-3291-4656-aa03-a64e24737602 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.752618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.753331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.753599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.753868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.754547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.756476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.779267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1297/2599] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:28:45 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:45.788511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.801704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fc49-ae72-4a4e-abd4-9b39d4b83877 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.811221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.812039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.812419 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.812783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.813611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.815604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.827759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1303/2600] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:45.832983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.844423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764879a-ba94-4771-add9-4a39a0754c45 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.849707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.850469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.850797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.851021 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.851844 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.853455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e53de-3bec-4690-9272-55f3edb5935f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.866124 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1298/2601] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:28:45.870980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:45.880921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7f0be-6fd7-461a-be2d-48a7afb0038b admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:45.885564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:45.886478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.886763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.887038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] PATH_INFO: `/v3/projects/776d8b4a6b184d36853b520eb08eb38b/users/2e3d79c36cb244279d8b1f3ff1ca9c1f/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.902556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776d8b4a6b184d36853b520eb08eb38b, user_id=2e3d79c36cb244279d8b1f3ff1ca9c1f, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:45.905274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:45.921123 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1304/2602] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:28:45 2022] PUT /identity/v3/projects/776d8b4a6b184d36853b520eb08eb38b/users/2e3d79c36cb244279d8b1f3ff1ca9c1f/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:45.927719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd4d8-101e-4b56-8045-53e51f4ede72 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:45.928045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd4d8-101e-4b56-8045-53e51f4ede72 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:45.928320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd4d8-101e-4b56-8045-53e51f4ede72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:45.946202 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3c4fd4d8-101e-4b56-8045-53e51f4ede72 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:45.947420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3c4fd4d8-101e-4b56-8045-53e51f4ede72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:46.008215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1299/2603] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:46.020155 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:46.021971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:46.082930 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d92ec-7718-46ee-ac30-1d834ef163d8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:46.087995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:46.088932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:46.089331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:46.089632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:46.101111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:46.102560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:46.113381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1305/2604] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:46.796307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:46.796794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:46.797002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:46.832677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] MFA Rules not processed for user `2e3d79c36cb244279d8b1f3ff1ca9c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:46.834669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:46.987848 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1300/2605] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:47.003444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:47.005835 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:47.105408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db68a-7c58-4661-85b8-cd2a8f279950 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:47.109471 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:47.110289 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:47.110903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:47.111182 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:47.120176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:47.121651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebcf7b-6e9e-43a2-8be7-2404f06b06ec service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:47.130621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1306/2606] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:47.769853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:47.771207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:47.869138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351b28-a4c1-4171-8fdf-8429b715f394 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:47.874756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:47.875426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:47.875704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:47.876007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:47.877797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:47.891466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:47.892094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9033ba5-707a-41f0-85c8-7234def495ac service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:47.905206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1301/2607] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:48.479864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:48.480466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:48.480466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:48.498303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] MFA Rules not processed for user `2e3d79c36cb244279d8b1f3ff1ca9c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:48.499522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:48.506779 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1307/2608] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:52.681209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:52.681855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:52.681855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:52.721522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:52.722842 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:52.809818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1302/2609] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 09:28:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:52.829654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:52.831641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:52.951854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa126b17-4d6c-4bc5-b047-039d6c9efc87 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:52.957242 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:52.957911 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:52.958181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:52.958647 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:52.969290 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:52.972043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c8c1c-e746-4a41-a834-ae38aab501d9 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:52.985696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1308/2610] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 09:28:55.685761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:55.688112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:55.720573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512338d-44c0-4af0-9bf8-c44a98de82f2 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:55.736030 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:55.737273 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:55.737760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:55.738238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] PATH_INFO: `/v3/users/7aa387483e1a45dd8b91e8202a2996c4` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:55.746403 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa387483e1a45dd8b91e8202a2996c4)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:55.749513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:55.888645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa387483e1a45dd8b91e8202a2996c4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:55.890417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa387483e1a45dd8b91e8202a2996c4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:55.896313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa387483e1a45dd8b91e8202a2996c4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:55.928739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa387483e1a45dd8b91e8202a2996c4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:55.946823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa387483e1a45dd8b91e8202a2996c4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:55.991402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1303/2611] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:55 2022] DELETE /identity/v3/users/7aa387483e1a45dd8b91e8202a2996c4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:55.993214 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:55.994345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:55.994900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:56.044831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:56.048768 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:56.219839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1309/2612] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:56.262685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:56.264978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:56.414020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d720d98-ea4a-4694-adae-1950c59c7963 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:56.422749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:56.424192 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:56.424666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:56.425296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:56.452951 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:56.454899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:56.481943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1304/2613] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:58.892633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:58.896015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:58.921838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be267e-24c7-41ed-9583-b7a047e61736 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:58.937972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:58.952975 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:58.953816 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:58.955191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] PATH_INFO: `/v3/projects/4776c0ee6a37451f8a3f95221c109f57` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:58.965800 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4776c0ee6a37451f8a3f95221c109f57)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:58.972960 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:59.072602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4776c0ee6a37451f8a3f95221c109f57', 'request_id': 'req-963cfa97-7249-47c3-bbba-6bd6d4d477ad'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.080374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4776c0ee6a37451f8a3f95221c109f57', 'request_id': 'req-963cfa97-7249-47c3-bbba-6bd6d4d477ad'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.097955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4776c0ee6a37451f8a3f95221c109f57', 'request_id': 'req-963cfa97-7249-47c3-bbba-6bd6d4d477ad'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.164310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] The token cache is being invalidate because project 4776c0ee6a37451f8a3f95221c109f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:59.164621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.176034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.182909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1310/2614] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:28:58 2022] DELETE /identity/v3/projects/4776c0ee6a37451f8a3f95221c109f57 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:59.187215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:59.202386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88eb3-3468-4fb8-9776-747af131492a service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:59.317053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:59.317943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:59.320184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:59.320874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] PATH_INFO: `/v3/users/936a593305744440a198cd2c028ccdbc` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:59.333097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936a593305744440a198cd2c028ccdbc)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:59.335134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:59.464466 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936a593305744440a198cd2c028ccdbc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.466569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936a593305744440a198cd2c028ccdbc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.471495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936a593305744440a198cd2c028ccdbc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.522667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936a593305744440a198cd2c028ccdbc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.536717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-16043713-46d4-41ed-ac10-60789898de66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936a593305744440a198cd2c028ccdbc'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:59.572433 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1305/2615] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:28:59 2022] DELETE /identity/v3/users/936a593305744440a198cd2c028ccdbc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:00.195527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.197694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:00.234161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cfa97-7249-47c3-bbba-6bd6d4d477ad admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.310519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.311970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.312444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.312890 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] PATH_INFO: `/v3/projects/2eee8b18a7914a2299afe5a9a175bea7` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.314834 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eee8b18a7914a2299afe5a9a175bea7)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.318297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.392681 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eee8b18a7914a2299afe5a9a175bea7', 'request_id': 'req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:00.398449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eee8b18a7914a2299afe5a9a175bea7', 'request_id': 'req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:00.415246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eee8b18a7914a2299afe5a9a175bea7', 'request_id': 'req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:00.437921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] The token cache is being invalidate because project 2eee8b18a7914a2299afe5a9a175bea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:00.438361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:00.439316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b7fc9881-0b94-4311-b0ea-05fcbafb2b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:00.441342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1311/2616] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:00 2022] DELETE /identity/v3/projects/2eee8b18a7914a2299afe5a9a175bea7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:29:00.446311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.446959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.446959 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.467229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:00.468544 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:00.536218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1306/2617] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:29:00.546997 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.547578 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.548241 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.573153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:00.574757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:00.583602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1312/2618] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:00.588320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.598687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe28969-e3dc-43fe-b7cf-baa0f556e26c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.603631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.604336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.604609 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.604907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.605623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:29:00.605938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.607530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.620147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1307/2619] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:29:00.624537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.640256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b0a2-c581-49f4-b79c-d57d210838c2 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.646070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.646662 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.646939 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.647250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.648045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.649969 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.685457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1313/2620] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:00 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:00.686719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.698171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94343e-a8ed-4a5f-8e05-c76b8116f5f1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.765991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.766894 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.767092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.767521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.768274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.770494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.794078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1308/2621] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:00 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:00.798496 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.812769 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4caa3-0979-4884-8e40-aba37f7ddaa9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.820176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.821293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.821752 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.822156 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.823060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.825245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.848443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1314/2622] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:00.849487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.869443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bdb3-db6b-48be-af3e-a052e4d01d0d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.874315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.874991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.875274 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.875550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.876321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.878200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c677f4-047f-4463-8bf5-82185b3535fe admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.889539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1309/2623] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:00.893781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:00.903905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cccb8f-d992-426f-8830-aea584410fd3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:00.908725 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:00.909660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.909936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.910213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] PATH_INFO: `/v3/projects/f7bae9b6aec640b1add354c6183b6beb/users/4a97618ba613487abdb434ead255aa78/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.926303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bae9b6aec640b1add354c6183b6beb, user_id=4a97618ba613487abdb434ead255aa78, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:00.929291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:00.943010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1315/2624] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:00 2022] PUT /identity/v3/projects/f7bae9b6aec640b1add354c6183b6beb/users/4a97618ba613487abdb434ead255aa78/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:29:00.953832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:00.954601 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:00.955164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:00.991583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] MFA Rules not processed for user `4a97618ba613487abdb434ead255aa78`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:00.993087 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:01.131862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1310/2625] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:01.139812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.285502 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca823e4-739f-49dd-bc7a-e03afda04fe9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.294932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.295793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.296165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.296533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.297820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.299344 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.341662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.350802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1316/2626] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:01 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:01.358322 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa9709-6661-479e-be4d-2d22cab066c9 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.449897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.450606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.450737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.451004 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.451690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.454109 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.480680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1311/2627] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:01 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:01.484849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.495338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e55e-7f7e-4482-a6f5-d6f0fa8dd192 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.500371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.501046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.501354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.501649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.502351 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.504176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.518071 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1317/2628] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:01.522561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.533020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdbc8-3e93-441d-97d9-872d6bbf9e92 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.538339 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.539092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.539486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.539801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.540780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.542486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df8d62-e425-40f9-b358-08455f5b97d6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.556405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1312/2629] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:01.561035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.572436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d60cc-0143-432b-87b2-08b4cdeae099 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.578087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.578978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.579259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.579537 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] PATH_INFO: `/v3/projects/e7eebe876f004463acc0917c1eb83ec5/users/5aa4cd17ae234dec88c14b1398309e48/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.595132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7eebe876f004463acc0917c1eb83ec5, user_id=5aa4cd17ae234dec88c14b1398309e48, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.597869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.612366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1318/2630] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:01 2022] PUT /identity/v3/projects/e7eebe876f004463acc0917c1eb83ec5/users/5aa4cd17ae234dec88c14b1398309e48/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:01.623750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.624181 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.624479 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.652769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] MFA Rules not processed for user `5aa4cd17ae234dec88c14b1398309e48`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:01.653975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:01.720655 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1313/2631] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:01.725247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.789589 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c90a7-4bac-4dd9-9019-5492b694b2e8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.794744 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.795445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.795728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.796043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.796732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.798630 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.824288 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1319/2632] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:01 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:01.828546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.839389 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c96fd-9bb9-4da1-8c09-a41c1c646f9d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.896618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.897285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.897547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.897828 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.898503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.900473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.920803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1314/2633] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:01 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:01.925083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.935399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965d3e3-4026-43de-ace0-b5be262239fd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.939938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.940587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.940864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.941133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.941849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.943435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:01.954596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1320/2634] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:01.959147 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:01.969939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9356e6-1949-441f-a0d4-64fef5a35f61 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:01.975053 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:01.975938 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:01.976289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:01.976610 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] PATH_INFO: `/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b/users/f4023903553044489f9e5894de6a9c26/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:01.992803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688d0f648ab46ca8c2159c6357a9c2b, user_id=f4023903553044489f9e5894de6a9c26, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:01.995488 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:02.014179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1315/2635] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:01 2022] PUT /identity/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b/users/f4023903553044489f9e5894de6a9c26/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:02.018860 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:02.029817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387d7a-85f8-447b-831c-7db336c7c378 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:02.090906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:02.091619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:02.091878 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:02.092217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:02.092854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:02.094440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c794-7ac9-4246-bea1-1b4dab6fa85b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:02.107805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1321/2636] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:02.111093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:02.125125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d540-3f88-457a-b19d-a97246c19620 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:02.132238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:02.133681 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:02.134093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:02.134504 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] PATH_INFO: `/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b/users/f4023903553044489f9e5894de6a9c26/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:02.137471 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688d0f648ab46ca8c2159c6357a9c2b, user_id=f4023903553044489f9e5894de6a9c26, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:02.141921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:02.156881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1316/2637] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:02 2022] PUT /identity/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b/users/f4023903553044489f9e5894de6a9c26/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:02.167633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:02.167988 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:02.168427 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:02.196687 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] MFA Rules not processed for user `f4023903553044489f9e5894de6a9c26`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:02.198094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:02.276220 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1322/2638] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:02.293211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:02.294992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:02.350563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d97-5085-468d-a6f3-8bd093b83719 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:02.356632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:02.357331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:02.357613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:02.357881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:02.367238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:02.368699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:02.379319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1317/2639] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:02.930072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:02.931894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:02.944703 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7f90-ce7a-493a-a5c7-d1407ebb39d6 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:02.949569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:02.950211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:02.950460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:02.950753 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:03.006171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:03.007602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:03.016481 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1323/2640] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:07.057226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:07.065990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfdd8-df0e-45ca-a0cf-d98e240889f5 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:07.070037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:07.070759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:07.071029 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:07.071297 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:07.130946 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:07.132497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea07d5-046d-41c9-80ba-43891e028ffc service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:07.141977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1318/2641] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:09.340797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:09.418206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7346-95a5-4182-83ad-949e63b303b3 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:09.422912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:09.423817 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:09.424100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:09.424518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] PATH_INFO: `/v3/users/4a97618ba613487abdb434ead255aa78` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:09.425741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a97618ba613487abdb434ead255aa78)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:09.427719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:09.483283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a97618ba613487abdb434ead255aa78'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:09.494343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a97618ba613487abdb434ead255aa78'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:09.518855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a97618ba613487abdb434ead255aa78'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:09.518855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a97618ba613487abdb434ead255aa78'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:09.518855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a97618ba613487abdb434ead255aa78'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:09.529570 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1324/2642] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:09 2022] DELETE /identity/v3/users/4a97618ba613487abdb434ead255aa78 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:09.534723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:09.535319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:09.535319 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:09.553928 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:09.555134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:09.638923 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1319/2643] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:09.649528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:09.651587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:09.741757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5016ef-2cca-4017-8422-66aa98178d96 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:09.748033 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:09.749144 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:09.749641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:09.750139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:09.767116 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:09.769970 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:09.788451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1325/2644] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:10.131243 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:10.134659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:10.162172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae37c9-53ee-4879-a2ad-366a8627c5c6 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:10.180135 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:10.181966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:10.181966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:10.181966 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] PATH_INFO: `/v3/projects/f7bae9b6aec640b1add354c6183b6beb` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:10.184176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bae9b6aec640b1add354c6183b6beb)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:10.186283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:10.252043 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bae9b6aec640b1add354c6183b6beb', 'request_id': 'req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.260323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bae9b6aec640b1add354c6183b6beb', 'request_id': 'req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.266069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bae9b6aec640b1add354c6183b6beb', 'request_id': 'req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.278885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] The token cache is being invalidate because project f7bae9b6aec640b1add354c6183b6beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:10.279682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.280417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.282636 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1320/2645] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:10 2022] DELETE /identity/v3/projects/f7bae9b6aec640b1add354c6183b6beb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:10.288727 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:10.303110 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cc2a-6e04-435c-8d0d-258113612080 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:10.379302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:10.380355 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:10.380640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:10.380916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] PATH_INFO: `/v3/users/5aa4cd17ae234dec88c14b1398309e48` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:10.382216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa4cd17ae234dec88c14b1398309e48)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:10.384315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:10.433108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa4cd17ae234dec88c14b1398309e48'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.442061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa4cd17ae234dec88c14b1398309e48'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.449735 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa4cd17ae234dec88c14b1398309e48'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.450449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa4cd17ae234dec88c14b1398309e48'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.450980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa4cd17ae234dec88c14b1398309e48'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.467607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1326/2646] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:10 2022] DELETE /identity/v3/users/5aa4cd17ae234dec88c14b1398309e48 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:10.758898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:10.760941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:10.790735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39fd2-ba52-4d6d-ae14-eca58220fcf4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:10.857712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:10.858576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:10.858850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:10.859118 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] PATH_INFO: `/v3/projects/e7eebe876f004463acc0917c1eb83ec5` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:10.860337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7eebe876f004463acc0917c1eb83ec5)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:10.862258 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:10.907829 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7eebe876f004463acc0917c1eb83ec5', 'request_id': 'req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.915530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7eebe876f004463acc0917c1eb83ec5', 'request_id': 'req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.920972 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7eebe876f004463acc0917c1eb83ec5', 'request_id': 'req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.931872 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] The token cache is being invalidate because project e7eebe876f004463acc0917c1eb83ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:10.932159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.932875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:10.934580 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1321/2647] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:10 2022] DELETE /identity/v3/projects/e7eebe876f004463acc0917c1eb83ec5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:10.939457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:10.941565 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:10.955479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d16e-1ab5-472b-bb84-ab8d19c9fc51 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:11.012702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:11.013507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.013781 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.014024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] PATH_INFO: `/v3/users/f4023903553044489f9e5894de6a9c26` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.015231 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4023903553044489f9e5894de6a9c26)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:11.017196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:11.064675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4023903553044489f9e5894de6a9c26'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.073014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4023903553044489f9e5894de6a9c26'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.080423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4023903553044489f9e5894de6a9c26'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.081072 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4023903553044489f9e5894de6a9c26'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.081704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e58557c7-a819-4b78-89bc-7a136341c9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4023903553044489f9e5894de6a9c26'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.098425 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1327/2648] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:10 2022] DELETE /identity/v3/users/f4023903553044489f9e5894de6a9c26 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:11.377365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:11.379114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:11.391918 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd3a19-2ca9-4bde-9da8-a068cfc3b9bb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:11.455310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:11.456215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.456494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.456766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] PATH_INFO: `/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.457965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2688d0f648ab46ca8c2159c6357a9c2b)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:11.460011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:11.506969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2688d0f648ab46ca8c2159c6357a9c2b', 'request_id': 'req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.514516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2688d0f648ab46ca8c2159c6357a9c2b', 'request_id': 'req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.520547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2688d0f648ab46ca8c2159c6357a9c2b', 'request_id': 'req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.532331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] The token cache is being invalidate because project 2688d0f648ab46ca8c2159c6357a9c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:11.532615 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.533337 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-a616a4de-5ec1-4251-be2c-e7dcde95aa0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:11.534853 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1322/2649] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:11 2022] DELETE /identity/v3/projects/2688d0f648ab46ca8c2159c6357a9c2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:11.541047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.541560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.541668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.560240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:11.561345 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:11.620666 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1328/2650] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:11.630365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.630611 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.630912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.649530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:11.650761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:11.660942 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1323/2651] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:11.722704 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:11.738191 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba250c8a-d2a4-4f01-a54e-ed9f42604abd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:11.745185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:11.746044 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.746536 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.746812 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.747916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:29:11.748379 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:11.749996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:11.769673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1329/2652] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:29:11.771666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:11.789600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea605cb9-90bf-4529-9e1c-add681bb051a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:11.797501 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:11.798576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.799081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.799857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.801228 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:11.804711 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:11.871133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1324/2653] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:11 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:11.871827 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:11.884557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f3234-60c0-44fd-ab03-28d5fd6f35f2 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:11.975154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:11.977193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:11.977778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:11.978337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:11.979737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:11.984513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:12.011610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1330/2654] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:11 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:12.017758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:12.029067 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563571fe-e4e1-46ab-892b-1664fbea82ba admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:12.033760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:12.034430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:12.034696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:12.035395 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:12.036033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:12.038037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:12.051738 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1325/2655] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:12.055651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:12.066256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e95ec-cc23-4711-9f21-4eaede3fc30f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:12.071185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:12.071968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:12.072308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:12.072795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:12.074014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:12.075690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc43d9-0c63-4eb2-823b-f3fc96e115b9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:12.091550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1331/2656] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:12.096873 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:12.109106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c61f-01b5-4e5f-a0e8-7183f609c1c4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:12.116707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:12.118296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:12.118841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:12.119345 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] PATH_INFO: `/v3/projects/fa70855069ed46b49244fa364e2d2283/users/f1619732fca54581b65810fa9c3f1573/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:12.137930 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa70855069ed46b49244fa364e2d2283, user_id=f1619732fca54581b65810fa9c3f1573, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:12.140823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:12.155506 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1326/2657] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:12 2022] PUT /identity/v3/projects/fa70855069ed46b49244fa364e2d2283/users/f1619732fca54581b65810fa9c3f1573/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:12.160685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93364b62-b42e-4196-816c-8e151904178a None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:12.160978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93364b62-b42e-4196-816c-8e151904178a None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:12.161269 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93364b62-b42e-4196-816c-8e151904178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:12.179646 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-93364b62-b42e-4196-816c-8e151904178a None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:12.180913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-93364b62-b42e-4196-816c-8e151904178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:12.260014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1332/2658] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:29:12.270469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:12.272524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:12.343178 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1bf67-921f-4c73-9b1a-dc6cd6ea7246 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:12.349511 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:12.350679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:12.351184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:12.351684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:12.370313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:12.372855 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:12.387484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1327/2659] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:13.065767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.067183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.067754 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.119009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] MFA Rules not processed for user `f1619732fca54581b65810fa9c3f1573`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:13.120807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:13.229529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1333/2660] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:13.235714 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.255051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33957-9d55-4d8e-af92-68da2dce2aa9 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.261220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.261992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.262427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.262800 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.263613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.266998 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.300094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1328/2661] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:13 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:13.305454 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.317581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b787dab-1630-40b2-b412-a5110ec40530 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.403322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.404031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.404318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.404596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.405287 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.407206 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.426784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1334/2662] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:13 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:13.432920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.443210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2db1c-42eb-49ca-8474-ec034860ef43 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.449351 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.450031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.450331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.450607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.451332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.452975 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.464476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1329/2663] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:29:13.468985 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.479477 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e99a-f7f8-439f-86f7-ad0c249397b3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.484905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.485831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.486176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.486458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] PATH_INFO: `/v3/projects/9bbe7da3302c47ea8a3be672416850be/users/e8fa55ee7e114361836c882cf60fe407/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.501240 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbe7da3302c47ea8a3be672416850be, user_id=e8fa55ee7e114361836c882cf60fe407, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.503972 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.517003 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1335/2664] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:13 2022] PUT /identity/v3/projects/9bbe7da3302c47ea8a3be672416850be/users/e8fa55ee7e114361836c882cf60fe407/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:13.521092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.532204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86635-79f5-47cc-a8ec-36ccc5783ef8 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.590768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.591434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.591929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.592194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.592920 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.594528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646691f8-9318-46b0-a0b4-76ea1d26df67 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.604300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1330/2665] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:29:13.608742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:13.619643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0150-4a28-4c71-8999-dcd1cc1e0db8 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:13.625236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:13.626091 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:13.626369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:13.626641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] PATH_INFO: `/v3/projects/9bbe7da3302c47ea8a3be672416850be/users/e8fa55ee7e114361836c882cf60fe407/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:13.628805 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbe7da3302c47ea8a3be672416850be, user_id=e8fa55ee7e114361836c882cf60fe407, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:13.631446 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:13.642710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1336/2666] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:13 2022] PUT /identity/v3/projects/9bbe7da3302c47ea8a3be672416850be/users/e8fa55ee7e114361836c882cf60fe407/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:29:14.262400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:14.263256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:14.263970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:14.296429 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] MFA Rules not processed for user `e8fa55ee7e114361836c882cf60fe407`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:14.297881 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:14.390977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1331/2667] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:14.410609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:14.413094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:14.507520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80095-0db6-48be-9b8f-9446c1044096 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:14.511322 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:14.512011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:14.512296 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:14.512583 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:14.582933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:14.584694 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2eecb-56c1-4dbe-9458-55c5f9d33779 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:14.595413 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1337/2668] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:16.032125 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:16.046963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae92d5-41dd-4a74-988f-8d5ba20f5a2d None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:16.051903 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:16.052562 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:16.052837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:16.053100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:16.063457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:16.065408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:16.076069 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1332/2669] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:18.764568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:18.767952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:18.768543 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:18.788613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] MFA Rules not processed for user `2e3d79c36cb244279d8b1f3ff1ca9c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:18.789833 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:18.849007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1338/2670] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:23.819112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:23.875826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec6142-d6b9-45db-8166-13d544cbbd02 service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:23.880367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:23.881020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:23.881407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:23.881682 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:23.883614 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:23.945230 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:23.946743 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:23.956344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1333/2671] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:25.638618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:25.640226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:25.718909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847a41-e257-4dcc-a2a6-fa0aa7503015 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:25.725461 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:25.726174 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:25.726457 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:25.726728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:25.729022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:25.743803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:25.745623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:25.767225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1339/2672] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:26.926670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:26.928277 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:26.942812 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15c43-3ece-4822-8de0-97e58a6bb666 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:26.947220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:26.948353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:26.948895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:26.949235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:26.951131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:26.966660 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:26.968378 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:26.981512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1334/2673] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:29.261995 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:29.336459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d85f4-a0a2-4fd3-80fe-a8ed790ad0c5 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:29.342015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:29.342884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:29.343201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:29.343441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] PATH_INFO: `/v3/users/f1619732fca54581b65810fa9c3f1573` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:29.344739 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1619732fca54581b65810fa9c3f1573)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:29.346656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:29.399443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1619732fca54581b65810fa9c3f1573'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.407106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1619732fca54581b65810fa9c3f1573'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.414177 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1619732fca54581b65810fa9c3f1573'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.414919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1619732fca54581b65810fa9c3f1573'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.415569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1619732fca54581b65810fa9c3f1573'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.438675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1340/2674] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:29 2022] DELETE /identity/v3/users/f1619732fca54581b65810fa9c3f1573 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:29:29.615469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:29.627491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45048-7f7b-4282-9483-f67d0c2669dd service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:29.700253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:29.701142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:29.701421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:29.701692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] PATH_INFO: `/v3/projects/fa70855069ed46b49244fa364e2d2283` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:29.702888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa70855069ed46b49244fa364e2d2283)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:29.704843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:29.759906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa70855069ed46b49244fa364e2d2283', 'request_id': 'req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.770330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa70855069ed46b49244fa364e2d2283', 'request_id': 'req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.775850 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa70855069ed46b49244fa364e2d2283', 'request_id': 'req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.787083 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] The token cache is being invalidate because project fa70855069ed46b49244fa364e2d2283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:29.787350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.788063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.791233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1335/2675] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:29 2022] DELETE /identity/v3/projects/fa70855069ed46b49244fa364e2d2283 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:29.795444 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:29.796927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:29.810245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a768f-79d0-480b-ac5f-509aaf2df929 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:29.874399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:29.875616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:29.876008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:29.876321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] PATH_INFO: `/v3/users/e8fa55ee7e114361836c882cf60fe407` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:29.878021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fa55ee7e114361836c882cf60fe407)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:29.880971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:29.936020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fa55ee7e114361836c882cf60fe407'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.945538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fa55ee7e114361836c882cf60fe407'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.952772 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fa55ee7e114361836c882cf60fe407'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.953411 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fa55ee7e114361836c882cf60fe407'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.954167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-c851682f-5b57-4c2e-ac6d-359fa37fbda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fa55ee7e114361836c882cf60fe407'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:29.972104 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1341/2676] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:29 2022] DELETE /identity/v3/users/e8fa55ee7e114361836c882cf60fe407 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:29:30.148727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.150251 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:30.163642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4c7fa-e0e6-4dd8-bf39-47ea6978c785 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.221976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.222862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.223137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.223393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] PATH_INFO: `/v3/projects/9bbe7da3302c47ea8a3be672416850be` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.224613 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbe7da3302c47ea8a3be672416850be)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.226517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.275162 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbe7da3302c47ea8a3be672416850be', 'request_id': 'req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:30.284174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbe7da3302c47ea8a3be672416850be', 'request_id': 'req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:30.290556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbe7da3302c47ea8a3be672416850be', 'request_id': 'req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:30.301986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] The token cache is being invalidate because project 9bbe7da3302c47ea8a3be672416850be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:30.302269 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:30.303038 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-6d68a372-1e5e-41cd-851a-e1559ec3b1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:30.304716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1336/2677] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:30 2022] DELETE /identity/v3/projects/9bbe7da3302c47ea8a3be672416850be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:30.311400 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.311984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.311984 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.330601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:30.331823 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:30.393473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1342/2678] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:30.401157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.401448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.401737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.420282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:30.421489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:30.439305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1337/2679] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:30.440532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.451519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fab7e-8f43-48d0-9e42-067dc75d4992 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.458053 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.458722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.458992 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.459335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.460021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:29:30.460325 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.461963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.478348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1343/2680] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:29:30.480331 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.489296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef0994-061a-433a-8f8e-56775d07dff1 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.512289 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.514165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.514574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.516384 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.518629 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.520473 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.557582 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1338/2681] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:30 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:30.561919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.572020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934714d-8b44-4391-ae60-173ebd2488fd admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.633036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.633723 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.634034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.634311 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.634996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.636926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.659291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1344/2682] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:30 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:29:30.663899 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.677803 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187758-4634-4eea-aae8-561729eaaccf admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.681810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.682868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.683299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.683689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.684650 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.686462 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.704569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1339/2683] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:30.708164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.726712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07fb3-2181-4112-abc2-20e7a9b93a95 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.746050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.747302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.747916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.748176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.748895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.750707 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f3826-30b9-4083-a324-16fef00db7d0 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.766598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1345/2684] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:30.773276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.784616 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1db2-dc39-4e66-9c8e-fab23f51ecb1 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:30.789792 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:30.790801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.791151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.791495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] PATH_INFO: `/v3/projects/d04759dc6f8f44a9b5e4981515bc6ba3/users/2d23edac9e224b4d9fe9e9f190628772/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.806268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04759dc6f8f44a9b5e4981515bc6ba3, user_id=2d23edac9e224b4d9fe9e9f190628772, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:30.809063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:30.822104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1340/2685] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:30 2022] PUT /identity/v3/projects/d04759dc6f8f44a9b5e4981515bc6ba3/users/2d23edac9e224b4d9fe9e9f190628772/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:30.841433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea0b-50b0-4b23-80fe-7529ec3b46ce None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:30.841936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea0b-50b0-4b23-80fe-7529ec3b46ce None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:30.842216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea0b-50b0-4b23-80fe-7529ec3b46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:30.871061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b02cea0b-50b0-4b23-80fe-7529ec3b46ce None None] MFA Rules not processed for user `2d23edac9e224b4d9fe9e9f190628772`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:30.872513 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b02cea0b-50b0-4b23-80fe-7529ec3b46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:30.939982 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1346/2686] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:30.949266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:30.951057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:31.007139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd31e9-6b2e-441a-8edf-1b7e35245bbb admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:31.010876 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:31.011533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:31.011839 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:31.012115 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:31.020574 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:31.022091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7b8a3-1138-49a7-9349-575a05dff1be service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:31.032065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1341/2687] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:32.393927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:32.394482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:32.394719 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:32.418893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] MFA Rules not processed for user `2d23edac9e224b4d9fe9e9f190628772`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:32.420140 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:32.427801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1347/2688] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:39.593857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a615b-4476-44f6-8227-9f68094d8041 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:39.594450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a615b-4476-44f6-8227-9f68094d8041 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:39.594566 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a615b-4476-44f6-8227-9f68094d8041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:39.623333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7e9a615b-4476-44f6-8227-9f68094d8041 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:39.624604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7e9a615b-4476-44f6-8227-9f68094d8041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:39.680205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1342/2689] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:39.702778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:39.704553 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:39.776811 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e926-596d-4fb4-9be2-3339bcf7d0da None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:39.782473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:39.783133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:39.783418 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:39.783691 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:39.792780 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:39.794389 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3f13-e5cb-4622-a2a4-233eb6fdd2e3 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:39.803670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1348/2690] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:42.063255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:42.063878 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:42.064006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:42.090191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] MFA Rules not processed for user `0f544c320b724a1fbd779f8ab51a7911`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:42.091715 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:42.152426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1343/2691] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:52.290462 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2996b-9f98-49f4-8e4b-0ac5c35414c6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:52.291390 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2996b-9f98-49f4-8e4b-0ac5c35414c6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:52.291879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2996b-9f98-49f4-8e4b-0ac5c35414c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:52.315927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2df2996b-9f98-49f4-8e4b-0ac5c35414c6 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:52.317767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2df2996b-9f98-49f4-8e4b-0ac5c35414c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:52.328999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1349/2692] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 09:29:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:52.344598 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:52.356956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc01cdb-ad43-4924-addd-aec0706aa0c4 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:52.362191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:52.363096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:52.363595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:52.364086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:52.373806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:52.375725 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:52.385425 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1344/2693] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:53.011260 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c904da0-0252-47f8-9792-d2c953321c3b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:53.011698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c904da0-0252-47f8-9792-d2c953321c3b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:53.011966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c904da0-0252-47f8-9792-d2c953321c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:53.032096 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-1c904da0-0252-47f8-9792-d2c953321c3b None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:53.033472 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-1c904da0-0252-47f8-9792-d2c953321c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:53.041639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1350/2694] 10.222.0.11 () {58 vars in 967 bytes} [Tue May 3 09:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:53.061027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:53.078887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157012-cee3-4b9e-8e4f-5fce7a9d50e7 service swift] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:53.085626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:53.086513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:53.086798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:53.087076 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:53.098453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:53.100283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:53.110480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1345/2695] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:53.394564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955885e-56d0-41a9-881e-2f74a5b802f0 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:53.395121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955885e-56d0-41a9-881e-2f74a5b802f0 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:53.395121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955885e-56d0-41a9-881e-2f74a5b802f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:53.419034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8955885e-56d0-41a9-881e-2f74a5b802f0 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:53.426259 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8955885e-56d0-41a9-881e-2f74a5b802f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:53.442262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1351/2696] 10.222.0.11 () {58 vars in 1009 bytes} [Tue May 3 09:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:53.533226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:53.551556 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310128-c7fa-420d-91a5-5822c73818e3 service swift] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:53.561405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:53.562097 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:53.562407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:53.564098 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:53.597602 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:53.600020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:53.616669 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1346/2697] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:54.281335 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afb8b-916d-4827-8d1d-7048a1f2cce4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:54.281660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afb8b-916d-4827-8d1d-7048a1f2cce4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:54.282166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afb8b-916d-4827-8d1d-7048a1f2cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:54.306166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b67afb8b-916d-4827-8d1d-7048a1f2cce4 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:54.307828 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b67afb8b-916d-4827-8d1d-7048a1f2cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:54.323169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1352/2698] 10.222.0.11 () {58 vars in 967 bytes} [Tue May 3 09:29:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:54.333105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:54.345197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5956e-5178-4b67-bf57-faacfcf7955d service swift] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:54.350852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:54.351808 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:54.353215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:54.353742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:54.364794 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:54.367262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:54.376926 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1347/2699] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:56.244342 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:56.244910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:56.245084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:56.264363 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:56.265587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:56.273398 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1353/2700] 10.222.0.11 () {58 vars in 967 bytes} [Tue May 3 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:56.286624 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:56.296955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c774ab-e9a1-41b1-b932-3a390e025d08 service swift] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:56.302253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:56.302925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:56.303199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:56.303470 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:56.311656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:56.313245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce8cce-f26e-4f9c-aa00-d0dbb4cd5e8e service swift] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:56.321442 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1348/2701] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:29:56.793793 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:56.859479 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bd3a1-501f-470a-8e36-179d036f0602 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:56.864293 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:56.865250 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:56.865764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:56.866202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] PATH_INFO: `/v3/users/2d23edac9e224b4d9fe9e9f190628772` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:56.867469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d23edac9e224b4d9fe9e9f190628772)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:56.869478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:56.919084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d23edac9e224b4d9fe9e9f190628772'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:56.926533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d23edac9e224b4d9fe9e9f190628772'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:56.933616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d23edac9e224b4d9fe9e9f190628772'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:56.934356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d23edac9e224b4d9fe9e9f190628772'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:56.935034 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d23edac9e224b4d9fe9e9f190628772'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:56.953655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1354/2702] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:56 2022] DELETE /identity/v3/users/2d23edac9e224b4d9fe9e9f190628772 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:56.960145 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:56.960455 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:56.960751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:56.978969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:56.980196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:57.039410 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1349/2703] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:29:57.054599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:57.056157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:57.146266 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f05b-0627-41a5-aa99-ca0132bd066e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:57.150999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:57.151785 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:57.152016 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:57.152503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:57.162517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:57.164002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:57.173568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1355/2704] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:57.348101 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:57.349748 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:57.367981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba102-6d4f-4080-8a14-6aaa96e7efe3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:57.373647 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:57.374540 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:57.374818 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:57.375078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] PATH_INFO: `/v3/projects/d04759dc6f8f44a9b5e4981515bc6ba3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:57.376436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04759dc6f8f44a9b5e4981515bc6ba3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:57.378837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:57.428911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'request_id': 'req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:57.438702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'request_id': 'req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:57.444958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'request_id': 'req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:57.457485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] The token cache is being invalidate because project d04759dc6f8f44a9b5e4981515bc6ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:57.457791 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:57.458535 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:57.460270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1350/2705] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:57 2022] DELETE /identity/v3/projects/d04759dc6f8f44a9b5e4981515bc6ba3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:58.494239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:58.496575 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:58.510713 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14f23-87bd-4afb-9e70-9412cec2bc52 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:58.569964 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:58.570966 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:58.571252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:58.571520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] PATH_INFO: `/v3/users/2e3d79c36cb244279d8b1f3ff1ca9c1f` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:58.573181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3d79c36cb244279d8b1f3ff1ca9c1f)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:58.575111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:58.644746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3d79c36cb244279d8b1f3ff1ca9c1f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:58.654587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3d79c36cb244279d8b1f3ff1ca9c1f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:58.662831 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3d79c36cb244279d8b1f3ff1ca9c1f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:58.663529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3d79c36cb244279d8b1f3ff1ca9c1f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:58.664160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3d79c36cb244279d8b1f3ff1ca9c1f'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:58.683958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1356/2706] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:29:58 2022] DELETE /identity/v3/users/2e3d79c36cb244279d8b1f3ff1ca9c1f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:58.708689 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:58.710255 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:58.773746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea43b-f6ab-4ffe-80d4-995fe8a0242c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:58.825868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:58.826533 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:58.826813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:58.827092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:58.829148 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:58.839046 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:58.840519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e458f-e6bb-4ac4-a6cd-f344eb2ef891 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:58.851452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1351/2707] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:29:58.872423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:58.875143 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:58.980022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4216a-d38c-4c9e-b7f8-6c8dbe0a2948 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:58.987423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:58.988581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:58.989024 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:58.989458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] PATH_INFO: `/v3/projects/776d8b4a6b184d36853b520eb08eb38b` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:58.991089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776d8b4a6b184d36853b520eb08eb38b)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:58.993061 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.047080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776d8b4a6b184d36853b520eb08eb38b', 'request_id': 'req-793433b6-c119-4519-9346-3df8046a1099'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:59.055291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776d8b4a6b184d36853b520eb08eb38b', 'request_id': 'req-793433b6-c119-4519-9346-3df8046a1099'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:59.064641 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776d8b4a6b184d36853b520eb08eb38b', 'request_id': 'req-793433b6-c119-4519-9346-3df8046a1099'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:59.076906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] The token cache is being invalidate because project 776d8b4a6b184d36853b520eb08eb38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:29:59.077300 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:59.077854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-793433b6-c119-4519-9346-3df8046a1099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:29:59.079451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1357/2708] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:29:58 2022] DELETE /identity/v3/projects/776d8b4a6b184d36853b520eb08eb38b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:59.084625 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.085190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.085539 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.104295 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:59.105731 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:59.176108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1352/2709] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:59.182038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.182038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.182038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.201085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:59.202669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:59.212614 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1358/2710] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:59.217045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.227329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48608-91bb-45c9-9bbb-b3970837a15f None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.232094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.232780 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.233055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.233325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.234066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:29:59.234366 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.236093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.248863 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1353/2711] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:29:59.253302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.263677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb598f-bc6f-4e92-9bd2-ed503fc8a03b None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.268718 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.269292 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.269571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.269838 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.270736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.272494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.300639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1359/2712] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:29:59 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:59.304560 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.314973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51640-1967-4812-9314-c7cbecf85e61 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.383329 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.383557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.383874 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.384151 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.384857 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.386817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.410323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1354/2713] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:29:59 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:29:59.414608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.425070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e4dd-37b2-491a-8c04-d7035c2fc5f9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.429689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.430353 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.430632 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.430904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.431875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.433474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.444343 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1360/2714] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:59.448581 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.458634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573a7b-6680-496b-83fb-de6dba05a6d0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.464318 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.464994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.465276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.465550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.466321 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.467965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462745-b862-4a7f-91f3-b82371731629 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.480854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1355/2715] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:29:59.485077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.495370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7149-b5f8-490a-b638-1687519a2455 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.501031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.501936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.502216 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.502490 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] PATH_INFO: `/v3/projects/353404d38a5146f7a3b8af30dab1d5ca/users/43100dfc4bf2428ba54270f35c1be292/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.519230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] RBAC: Authorizing `identity:create_grant(project_id=353404d38a5146f7a3b8af30dab1d5ca, user_id=43100dfc4bf2428ba54270f35c1be292, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.522014 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.538084 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1361/2716] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:29:59 2022] PUT /identity/v3/projects/353404d38a5146f7a3b8af30dab1d5ca/users/43100dfc4bf2428ba54270f35c1be292/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:29:59.548569 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.548925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.549315 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.577231 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] MFA Rules not processed for user `43100dfc4bf2428ba54270f35c1be292`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:29:59.578416 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:59.643386 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1356/2717] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:29:59.655076 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:29:59.656904 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:29:59.713737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45696bdc-4c18-4a9c-b899-d37e1ff3330e admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:29:59.717643 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:29:59.718339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:29:59.718628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:29:59.718899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:29:59.727278 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:29:59.728746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d35c4-4ef6-42d5-85ae-c90502cb7193 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:29:59.738035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1362/2718] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:30:02.293218 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:02.384431 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af8e4c-51c1-4052-bd46-e4b09ccacb93 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:02.389814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:02.390699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:02.390954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:02.391221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] PATH_INFO: `/v3/users/43100dfc4bf2428ba54270f35c1be292` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:02.392491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43100dfc4bf2428ba54270f35c1be292)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:02.395308 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:02.445687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43100dfc4bf2428ba54270f35c1be292'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:02.446355 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43100dfc4bf2428ba54270f35c1be292'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:02.447301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43100dfc4bf2428ba54270f35c1be292'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:02.459935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43100dfc4bf2428ba54270f35c1be292'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:02.470846 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43100dfc4bf2428ba54270f35c1be292'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:02.483733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1357/2719] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:30:02 2022] DELETE /identity/v3/users/43100dfc4bf2428ba54270f35c1be292 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:02.488798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:02.490121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:02.490540 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:02.507656 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:02.508891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:02.570798 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1363/2720] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:02.580945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:02.582360 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:02.645822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70514-fa8a-4ed2-a0f5-75d13756ff95 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:02.649490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:02.650131 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:02.650380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:02.650648 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:02.659912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:02.661369 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7587e-1f35-46e5-b825-40d86111ac61 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:02.671597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1358/2721] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:02.942676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:02.944263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:02.958809 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499734ac-e7ca-467d-9509-7c580552d929 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:02.965002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:02.966004 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:02.966519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:02.966818 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] PATH_INFO: `/v3/projects/353404d38a5146f7a3b8af30dab1d5ca` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:02.968350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353404d38a5146f7a3b8af30dab1d5ca)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:02.971635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.026517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353404d38a5146f7a3b8af30dab1d5ca', 'request_id': 'req-6aafd3dd-6905-4eca-b817-a7e9294d9f88'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:03.032281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353404d38a5146f7a3b8af30dab1d5ca', 'request_id': 'req-6aafd3dd-6905-4eca-b817-a7e9294d9f88'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:03.041607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353404d38a5146f7a3b8af30dab1d5ca', 'request_id': 'req-6aafd3dd-6905-4eca-b817-a7e9294d9f88'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:03.052520 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] The token cache is being invalidate because project 353404d38a5146f7a3b8af30dab1d5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:03.052801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:03.053483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-6aafd3dd-6905-4eca-b817-a7e9294d9f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:03.055046 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1364/2722] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:30:02 2022] DELETE /identity/v3/projects/353404d38a5146f7a3b8af30dab1d5ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:03.060227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.060550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.060805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.078901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:03.080108 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:03.141326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1359/2723] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:03.149310 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.149596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.149870 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.170146 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:03.171534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:03.180494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1365/2724] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:03.185037 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.194746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b8fb-7f9a-4bad-82b3-31ec69eaedc7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.200599 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.201260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.201532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.202035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.202750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:03.203051 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.204741 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.218079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1360/2725] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:03.222587 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.231875 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29888a7-5bd6-40e5-932e-7336803094a3 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.237560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.238217 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.238493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.238759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.239459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.241410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.269642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1366/2726] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:30:03 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:03.274018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.284736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80a59-4eea-4876-ae87-27423a7ffc1c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.341755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.342507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.342713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.342981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.343639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.345577 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.367237 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1361/2727] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:30:03 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:03.371757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.381807 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb741b78-950a-4a58-ae7b-e706e862a7e9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.386473 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.387121 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.387397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.387665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.388406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.390085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.400360 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1367/2728] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:03.404248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.414520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fddca-a63e-440d-8725-9b548d26c4c3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.419619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.420296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.420632 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.420956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.421673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.423338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f566e1-c571-4a2c-92a3-832c0de892a8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.433006 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1362/2729] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:03.436952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.446495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa421-baad-4847-92e1-26967dfa5b27 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.451567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.452512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.452791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.453063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] PATH_INFO: `/v3/projects/66f16754f7b74b83ade2390f492fcef8/users/abd63f3fabf542a9a6e9a80c3512bd94/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.466955 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f16754f7b74b83ade2390f492fcef8, user_id=abd63f3fabf542a9a6e9a80c3512bd94, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.469743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.486476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1368/2730] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:30:03 2022] PUT /identity/v3/projects/66f16754f7b74b83ade2390f492fcef8/users/abd63f3fabf542a9a6e9a80c3512bd94/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:03.497963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.498253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.498529 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.526139 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] MFA Rules not processed for user `abd63f3fabf542a9a6e9a80c3512bd94`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:03.527407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:03.600907 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1363/2731] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:03.612921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:03.614826 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:03.672236 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb017-5496-422e-ba38-bf873298df0d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:03.676764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:03.677399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:03.677683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:03.677963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:03.686763 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:03.688233 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808c1a3-9f21-43c3-ae48-f204a3152b60 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:03.697590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1369/2732] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:30:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:38.934735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.004887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96de8-b7f4-4ee5-b712-24b70147c110 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:39.010238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:39.011127 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.011400 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.011667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] PATH_INFO: `/v3/users/abd63f3fabf542a9a6e9a80c3512bd94` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.012988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd63f3fabf542a9a6e9a80c3512bd94)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:39.014929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:39.072634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd63f3fabf542a9a6e9a80c3512bd94'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.073516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd63f3fabf542a9a6e9a80c3512bd94'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.074363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd63f3fabf542a9a6e9a80c3512bd94'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.089195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd63f3fabf542a9a6e9a80c3512bd94'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.099055 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd63f3fabf542a9a6e9a80c3512bd94'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.110766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1364/2733] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:30:38 2022] DELETE /identity/v3/users/abd63f3fabf542a9a6e9a80c3512bd94 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:39.115640 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.116222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.116222 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.134917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:39.136282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:39.211249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1370/2734] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:39.223958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.225640 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:39.284768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81aee-9224-4d8d-a4c5-59b2f002a004 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:39.288766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:39.289380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.289679 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.289949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.299253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:39.300710 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bff2b-3287-41dc-ae28-7d55ee17f57b service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:39.309884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1365/2735] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:39.586786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.588337 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:39.602128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83da9-cd41-411d-b72d-eb8cb302c461 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:39.607659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:39.608634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.608901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.609169 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] PATH_INFO: `/v3/projects/66f16754f7b74b83ade2390f492fcef8` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.610388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f16754f7b74b83ade2390f492fcef8)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:39.613506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:39.664035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f16754f7b74b83ade2390f492fcef8', 'request_id': 'req-59ee43f7-f032-4bf7-9a94-b96df4276732'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.669493 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f16754f7b74b83ade2390f492fcef8', 'request_id': 'req-59ee43f7-f032-4bf7-9a94-b96df4276732'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.678047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f16754f7b74b83ade2390f492fcef8', 'request_id': 'req-59ee43f7-f032-4bf7-9a94-b96df4276732'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.689624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] The token cache is being invalidate because project 66f16754f7b74b83ade2390f492fcef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:39.689913 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.690664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-59ee43f7-f032-4bf7-9a94-b96df4276732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:39.692354 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1371/2736] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:30:39 2022] DELETE /identity/v3/projects/66f16754f7b74b83ade2390f492fcef8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:39.697864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.698156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.698434 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.718510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:39.719746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:39.801802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1366/2737] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:39.810932 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.811202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.811508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.831728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:39.832947 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:39.842806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1372/2738] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:30:39.848955 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.859666 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946c078-bc04-40d9-913c-4bd2fd20eb92 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:39.865336 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:39.866008 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.866281 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.866550 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.867260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:39.867563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:39.869196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:39.881576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1367/2739] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:39.886615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.898068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364051-c66f-4805-8473-d63e99e22409 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:39.903623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:39.904329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:39.904608 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:39.904915 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:39.905620 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:39.907531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:39.936308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1373/2740] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:30:39 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:39.942605 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:39.954658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1339a-ab3a-4997-8f23-42a6fc6730ae admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:40.017334 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:40.017922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.018203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.018474 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.019169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:40.021129 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:40.046424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1368/2741] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:30:39 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:40.053480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:40.068253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7b30-00f3-4caa-bb61-74018f3b151a admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:40.074041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:40.074695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.074996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.075258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.076022 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:40.077606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:40.088507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1374/2742] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:40.092887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:40.103155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d904-0ed6-487b-abe1-9116a6c6ba10 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:40.107924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:40.108608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.108871 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.109141 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.109858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:40.111483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58260c5b-ab7d-4cea-9ea6-9b3c882b51d4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:40.121252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1369/2743] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:40.125810 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:40.136518 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10877-dc71-46f6-81a0-0ea49777f4c6 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:40.141308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:40.142224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.142516 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.142795 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] PATH_INFO: `/v3/projects/fa09ab18b0f04eba8ee80cded3ba8c33/users/324ea07170b8409398d4b18baa4c7eca/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.161364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa09ab18b0f04eba8ee80cded3ba8c33, user_id=324ea07170b8409398d4b18baa4c7eca, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:40.164145 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:40.182698 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1375/2744] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:30:40 2022] PUT /identity/v3/projects/fa09ab18b0f04eba8ee80cded3ba8c33/users/324ea07170b8409398d4b18baa4c7eca/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:40.198555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.198851 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.199210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.228093 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] MFA Rules not processed for user `324ea07170b8409398d4b18baa4c7eca`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:40.229311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:40.297795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1370/2745] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:40.309399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:40.311243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:40.374882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fa3-91f6-404f-86ad-115c2aa10f1d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:40.379086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:40.379761 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:40.380089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:40.380332 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:40.389255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:40.390729 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955824e-a7b2-4d52-93c7-bbd9d61c1e8e service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:40.399804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1376/2746] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:30:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:57.883749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:57.959971 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788f6ad-92d6-4c78-babf-f90d2666c12c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:57.966233 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:57.967201 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:57.967476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:57.967752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] PATH_INFO: `/v3/users/324ea07170b8409398d4b18baa4c7eca` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:57.969190 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=324ea07170b8409398d4b18baa4c7eca)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:57.971154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:58.025721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324ea07170b8409398d4b18baa4c7eca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:58.026454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324ea07170b8409398d4b18baa4c7eca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:58.027166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324ea07170b8409398d4b18baa4c7eca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:58.039057 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324ea07170b8409398d4b18baa4c7eca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:58.048272 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324ea07170b8409398d4b18baa4c7eca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:58.072160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1371/2747] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:30:57 2022] DELETE /identity/v3/users/324ea07170b8409398d4b18baa4c7eca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:58.074087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:58.074616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:58.074616 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:58.092382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:58.093576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:58.163869 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1377/2748] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:58.174084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:58.175747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:58.253965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee6bc6-c47d-480d-ad63-e47c40fc5dea admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:58.258469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:58.259207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:58.259749 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:58.260133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:58.270427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:58.274157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e209cd-720e-44aa-8073-41d8c78999d8 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:58.285066 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1372/2749] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:58.996298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:58.998002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:59.013639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3880be-b0c9-4e47-8e41-67671f74ffbe None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:59.020762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:59.022298 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:59.022759 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:59.023213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] PATH_INFO: `/v3/projects/fa09ab18b0f04eba8ee80cded3ba8c33` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:59.024670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa09ab18b0f04eba8ee80cded3ba8c33)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:59.027443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:59.095700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16092c-698b-4e6c-ae61-f7e95f1a11e3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:59.096270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16092c-698b-4e6c-ae61-f7e95f1a11e3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:59.096407 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16092c-698b-4e6c-ae61-f7e95f1a11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:59.118986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-fc16092c-698b-4e6c-ae61-f7e95f1a11e3 None None] MFA Rules not processed for user `c714cc67e58f41db9fc9a37671111ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:59.120586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-fc16092c-698b-4e6c-ae61-f7e95f1a11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:59.132157 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa09ab18b0f04eba8ee80cded3ba8c33', 'request_id': 'req-df620cdf-f0d9-4743-8d87-46a99a8a0913'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:59.139824 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa09ab18b0f04eba8ee80cded3ba8c33', 'request_id': 'req-df620cdf-f0d9-4743-8d87-46a99a8a0913'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:59.161239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa09ab18b0f04eba8ee80cded3ba8c33', 'request_id': 'req-df620cdf-f0d9-4743-8d87-46a99a8a0913'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:59.177258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] The token cache is being invalidate because project fa09ab18b0f04eba8ee80cded3ba8c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:59.177552 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:59.178209 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:59.180138 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1378/2750] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:30:58 2022] DELETE /identity/v3/projects/fa09ab18b0f04eba8ee80cded3ba8c33 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:59.242852 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1373/2751] 10.222.0.11 () {58 vars in 967 bytes} [Tue May 3 09:30:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:30:59.301015 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:59.302508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:59.398399 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df620cdf-f0d9-4743-8d87-46a99a8a0913 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:59.405185 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4065401c1645baa29331521821162e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:59.406207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:59.406549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:59.406749 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:59.418162 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:59.420049 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:59.429841 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1379/2752] 10.222.0.11 () {60 vars in 1384 bytes} [Tue May 3 09:30:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:31:02.591702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:02.592302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:02.592704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:02.622102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] MFA Rules not processed for user `0f544c320b724a1fbd779f8ab51a7911`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:02.623701 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:02.721668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1374/2753] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:31:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:07.634506 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:07.636080 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:07.701373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2521864-f461-469b-a803-80f4be1e0123 service swift] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:07.706397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:07.707270 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:07.707549 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:07.707851 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] PATH_INFO: `/v3/users/8cc2d7dd95774cb2b0b9c695f222b6cc` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:07.709079 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc2d7dd95774cb2b0b9c695f222b6cc)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:07.711009 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:07.759598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc2d7dd95774cb2b0b9c695f222b6cc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:07.768090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc2d7dd95774cb2b0b9c695f222b6cc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:07.775247 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc2d7dd95774cb2b0b9c695f222b6cc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:07.775974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc2d7dd95774cb2b0b9c695f222b6cc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:07.776668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc2d7dd95774cb2b0b9c695f222b6cc'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:07.794303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1380/2754] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:31:07 2022] DELETE /identity/v3/users/8cc2d7dd95774cb2b0b9c695f222b6cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:31:07.970222 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:07.981256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f1a54-694d-4f17-bb34-2f10e66d92a7 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:08.040253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:08.041138 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:08.041415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:08.041686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] PATH_INFO: `/v3/projects/ee51b7929c5e4bcc845946df0d46f6c6` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:08.042963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee51b7929c5e4bcc845946df0d46f6c6)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:08.044922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:08.095866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee51b7929c5e4bcc845946df0d46f6c6', 'request_id': 'req-e9cb240c-d05e-4359-a207-b945552a98e4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.104521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee51b7929c5e4bcc845946df0d46f6c6', 'request_id': 'req-e9cb240c-d05e-4359-a207-b945552a98e4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.110424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee51b7929c5e4bcc845946df0d46f6c6', 'request_id': 'req-e9cb240c-d05e-4359-a207-b945552a98e4'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.121314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] The token cache is being invalidate because project ee51b7929c5e4bcc845946df0d46f6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:08.121604 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.122266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.123901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1375/2755] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:31:07 2022] DELETE /identity/v3/projects/ee51b7929c5e4bcc845946df0d46f6c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:31:08.127803 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:08.129323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:08.143675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983efa2a-8f8c-4f69-85f4-4641203c09f4 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:08.203624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:08.203624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:08.203624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:08.203624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] PATH_INFO: `/v3/users/7efbb7f73b9b4bc2b8299fad671c9016` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:08.204164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efbb7f73b9b4bc2b8299fad671c9016)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:08.205674 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:08.251203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efbb7f73b9b4bc2b8299fad671c9016'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.258895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efbb7f73b9b4bc2b8299fad671c9016'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.266054 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efbb7f73b9b4bc2b8299fad671c9016'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.266711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efbb7f73b9b4bc2b8299fad671c9016'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.267313 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-111be692-5e1b-4afb-8067-f416794d5320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efbb7f73b9b4bc2b8299fad671c9016'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.285610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1381/2756] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:31:08 2022] DELETE /identity/v3/users/7efbb7f73b9b4bc2b8299fad671c9016 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:08.458262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:08.459729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:08.473561 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb240c-d05e-4359-a207-b945552a98e4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:08.547933 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:08.548799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:08.549077 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:08.549347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] PATH_INFO: `/v3/projects/c3886d294c68464d88dd4a9e97971769` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:08.550531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3886d294c68464d88dd4a9e97971769)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:08.552486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:08.599024 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3886d294c68464d88dd4a9e97971769', 'request_id': 'req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.607668 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3886d294c68464d88dd4a9e97971769', 'request_id': 'req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.613086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3886d294c68464d88dd4a9e97971769', 'request_id': 'req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.623911 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] The token cache is being invalidate because project c3886d294c68464d88dd4a9e97971769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:08.624195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.624820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:08.626657 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1376/2757] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:31:08 2022] DELETE /identity/v3/projects/c3886d294c68464d88dd4a9e97971769 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:32:06.187359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:32:06.188006 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:32:06.188139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:32:06.206128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] MFA Rules not processed for user `0f544c320b724a1fbd779f8ab51a7911`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:32:06.207435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:32:06.261532 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1382/2758] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:32:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:32:09.453921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:32:09.455621 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:32:09.527398 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcffba7-5d1a-4bba-8cc5-895ad4e1e36f admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:32:09.533171 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:32:09.533814 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:32:09.534096 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:32:09.534375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:32:09.536423 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:32:09.548563 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:32:09.550150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:32:09.561165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1377/2759] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:32:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:06.553262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:06.554880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:06.619889 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20f202-02fa-43ec-9d25-65a844a8737d None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:06.624766 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:06.625714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:06.626102 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:06.626441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:06.629796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:06.712777 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:06.714277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:06.734560 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1383/2760] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:07.668454 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:07.670132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:07.688252 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766176-257b-44d1-a25d-b0af4f43f653 service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:07.696719 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:07.698091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:07.698480 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:07.698992 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:07.701350 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:07.725517 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:07.727347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:07.743219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1378/2761] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:15.310449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:15.320042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9962f-6f51-4e11-8328-e87e2a55faa3 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:15.324572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:15.325338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:15.325621 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:15.325894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:15.328019 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:15.402819 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:15.404338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:15.414542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1384/2762] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:16.988654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:16.990100 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:17.006953 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c50a7-d596-4f10-9940-90f756e8b070 service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.011698 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.012702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.012987 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.013261 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] PATH_INFO: `/v3/users/0f544c320b724a1fbd779f8ab51a7911` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.014477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f544c320b724a1fbd779f8ab51a7911)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.016451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.065126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f544c320b724a1fbd779f8ab51a7911'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.066301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f544c320b724a1fbd779f8ab51a7911'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.066964 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f544c320b724a1fbd779f8ab51a7911'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.079014 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f544c320b724a1fbd779f8ab51a7911'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.086341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-3531b105-de0b-41bd-a0b7-4dbd21b71b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f544c320b724a1fbd779f8ab51a7911'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.098132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1379/2763] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:16 2022] DELETE /identity/v3/users/0f544c320b724a1fbd779f8ab51a7911 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:17.273251 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.287274 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578a32c-dce7-4c07-b80b-aadc47391d2d service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.343897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.344762 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.345045 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.345317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] PATH_INFO: `/v3/projects/273a7688b38c4558b4c223ba1d9ecdf2` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.346522 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=273a7688b38c4558b4c223ba1d9ecdf2)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.348489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.396073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273a7688b38c4558b4c223ba1d9ecdf2', 'request_id': 'req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.402077 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273a7688b38c4558b4c223ba1d9ecdf2', 'request_id': 'req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.410558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273a7688b38c4558b4c223ba1d9ecdf2', 'request_id': 'req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.422038 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] The token cache is being invalidate because project 273a7688b38c4558b4c223ba1d9ecdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:17.422366 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.423048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-2c2c07a5-2c9f-4bcb-81a8-d6ab30b154bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:17.424737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1385/2764] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:17 2022] DELETE /identity/v3/projects/273a7688b38c4558b4c223ba1d9ecdf2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:17.429751 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.430035 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.430311 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.448774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:17.450027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:17.509071 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1380/2765] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:17.517318 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.517538 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.517814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.536103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:17.537291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:17.545845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1386/2766] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:17.550192 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.560463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3b9a1-1447-4623-9259-97cb46b45fe8 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.566606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.567262 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.567537 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.567832 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.568554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:33:17.568856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.570457 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.582733 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1381/2767] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:33:17.587131 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.596938 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a71a26-13e1-44c3-ba5b-5fd992a12939 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.602171 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.602820 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.603099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.603370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.604088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.606092 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.634814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1387/2768] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:33:17.639375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.649979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1941f-d8f4-4cb9-8fb2-7434b2c06c97 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.719477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.720200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.720476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.720744 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.721448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.723379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.744164 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1382/2769] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:17.748423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.759120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9316d-7927-48fc-84c8-7035c2507207 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.764482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.765135 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.765416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.765690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.766412 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.768107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.778606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1388/2770] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:17.782883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.793065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6be4d-99e0-4e29-93a3-bf3e10f1c2d0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.797932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.798583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.798866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.799126 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.799888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.801463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08070e-91f7-4ce9-885e-f91278e59e50 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.811257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1383/2771] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:33:17.815452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:17.826213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccae33-64ea-4694-8a6f-814d77511afe admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:17.831528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:17.832450 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.832736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.833011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] PATH_INFO: `/v3/projects/64777f6be7cf473791e8af6d1ddf7543/users/c30994678b714b07a897dad07ae1e601/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.847459 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64777f6be7cf473791e8af6d1ddf7543, user_id=c30994678b714b07a897dad07ae1e601, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:17.850164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:17.864328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1389/2772] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:17 2022] PUT /identity/v3/projects/64777f6be7cf473791e8af6d1ddf7543/users/c30994678b714b07a897dad07ae1e601/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:17.875342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:17.875623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:17.875936 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:17.903696 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] MFA Rules not processed for user `c30994678b714b07a897dad07ae1e601`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:17.904922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:17.971291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1384/2773] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:17.976068 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.039572 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f384d7-9e5b-4b72-b5bb-dce4709f9c74 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.045090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.045747 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.046028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.046297 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.046986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.048949 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.075205 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1390/2774] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:17 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:18.079307 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.090042 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c1047-fedd-4be0-a25e-6cf8ff333fc5 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.146663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.147338 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.147620 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.147952 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.148634 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.150573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.171685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1385/2775] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:18 2022] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:18.175893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.188426 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af146d3-41c2-49cd-aff4-343bf581152f admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.194160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.194825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.195108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.195381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.196149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.197755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.208956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1391/2776] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:18.213176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.223286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefda3-cea5-499b-8a09-45ac13f38dfd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.228941 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.229826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.230103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.230370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] PATH_INFO: `/v3/projects/9ef3656e5a324f26b9a88f96bdbca949/users/9e4ae750e4e74504b3faded301e704df/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.246512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef3656e5a324f26b9a88f96bdbca949, user_id=9e4ae750e4e74504b3faded301e704df, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.249242 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.263363 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1386/2777] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:18 2022] PUT /identity/v3/projects/9ef3656e5a324f26b9a88f96bdbca949/users/9e4ae750e4e74504b3faded301e704df/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:33:18.267581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.277814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034c44f-7cea-47ba-9ab1-b5dffec47342 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.336074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.336652 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.336934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.337207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.337934 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.339550 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bc71-ccc0-4489-a1f8-12cf4c02db7c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.349613 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1392/2778] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:18.354081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.365084 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864b09-e922-4c11-8676-81f45de6bd86 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.370995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.371925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.372207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.372477 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] PATH_INFO: `/v3/projects/9ef3656e5a324f26b9a88f96bdbca949/users/9e4ae750e4e74504b3faded301e704df/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.374677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef3656e5a324f26b9a88f96bdbca949, user_id=9e4ae750e4e74504b3faded301e704df, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.377409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.388806 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1387/2779] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:18 2022] PUT /identity/v3/projects/9ef3656e5a324f26b9a88f96bdbca949/users/9e4ae750e4e74504b3faded301e704df/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:18.399020 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.399334 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.399622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.427258 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] MFA Rules not processed for user `9e4ae750e4e74504b3faded301e704df`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:18.428515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:18.504700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1393/2780] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:33:18.517486 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.519713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:18.611597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9212f-c1b9-4fcf-8493-a48c932b5e17 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.616620 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.617267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.617530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.617820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.627123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.628592 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8877ac-25e8-4068-8dac-be086bf8b985 service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.637984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1388/2781] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:18.780279 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:18.845776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fbd3c-972b-43e0-8c1e-c063659d03ca None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:18.850801 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:18.851685 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.851996 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.852264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] PATH_INFO: `/v3/users/c30994678b714b07a897dad07ae1e601` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.853482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30994678b714b07a897dad07ae1e601)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:18.855393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:18.903283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30994678b714b07a897dad07ae1e601'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:18.911374 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30994678b714b07a897dad07ae1e601'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:18.918295 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30994678b714b07a897dad07ae1e601'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:18.918942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30994678b714b07a897dad07ae1e601'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:18.919529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30994678b714b07a897dad07ae1e601'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:18.937778 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1394/2782] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:18 2022] DELETE /identity/v3/users/c30994678b714b07a897dad07ae1e601 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:18.942921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:18.943212 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:18.943475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:18.961196 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:18.962397 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:19.030677 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1389/2783] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:33:19.040965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:19.042675 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:19.101907 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379096-c121-4cfc-8f46-51cf5328df90 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:19.106323 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:19.106958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:19.107211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:19.107500 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:19.117476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:19.118900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:19.128356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1395/2784] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:19.397628 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:19.399154 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:19.411532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc33e-5a0d-432a-8612-db442a948150 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:19.417080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:19.417957 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:19.418220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:19.418503 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] PATH_INFO: `/v3/projects/64777f6be7cf473791e8af6d1ddf7543` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:19.419856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64777f6be7cf473791e8af6d1ddf7543)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:19.421817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:19.469176 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64777f6be7cf473791e8af6d1ddf7543', 'request_id': 'req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.478058 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64777f6be7cf473791e8af6d1ddf7543', 'request_id': 'req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.483717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64777f6be7cf473791e8af6d1ddf7543', 'request_id': 'req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.494879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] The token cache is being invalidate because project 64777f6be7cf473791e8af6d1ddf7543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:19.495157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.495879 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.497510 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1390/2785] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:19 2022] DELETE /identity/v3/projects/64777f6be7cf473791e8af6d1ddf7543 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:19.501758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:19.511487 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bfcc2-6130-49a7-8624-5c1b0666f793 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:19.568012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:19.568905 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:19.569179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:19.569483 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] PATH_INFO: `/v3/users/9e4ae750e4e74504b3faded301e704df` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:19.570710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4ae750e4e74504b3faded301e704df)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:19.572670 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:19.624252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4ae750e4e74504b3faded301e704df'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.632397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4ae750e4e74504b3faded301e704df'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.639119 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4ae750e4e74504b3faded301e704df'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.639814 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4ae750e4e74504b3faded301e704df'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.640517 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-28889d90-8ba0-4ce5-85db-5da8c2af998c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4ae750e4e74504b3faded301e704df'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:19.659595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1396/2786] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:19 2022] DELETE /identity/v3/users/9e4ae750e4e74504b3faded301e704df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:19.954772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:19.956483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:19.971443 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66dd0f-18fb-45e3-8590-8d11d2c3e2d0 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.031144 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.031921 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.032200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.032469 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] PATH_INFO: `/v3/projects/9ef3656e5a324f26b9a88f96bdbca949` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.033631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef3656e5a324f26b9a88f96bdbca949)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.035567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.084401 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef3656e5a324f26b9a88f96bdbca949', 'request_id': 'req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:20.092766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef3656e5a324f26b9a88f96bdbca949', 'request_id': 'req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:20.098137 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef3656e5a324f26b9a88f96bdbca949', 'request_id': 'req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:20.109215 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] The token cache is being invalidate because project 9ef3656e5a324f26b9a88f96bdbca949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:20.109500 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:20.110161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b14aae61-d6e8-48dc-8008-edd5d9fac7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:20.111729 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1391/2787] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:19 2022] DELETE /identity/v3/projects/9ef3656e5a324f26b9a88f96bdbca949 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:20.116879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.117161 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.117436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.135315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:20.136534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:20.211994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1397/2788] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:20.220870 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.221150 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.221420 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.240558 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:20.241739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:20.250947 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1392/2789] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:20.256069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.271746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1d13-f975-4285-b5ac-497e05ac6c43 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.279963 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.280619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.280895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.281221 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.281884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:33:20.282186 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.283804 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.296588 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1398/2790] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:33:20.302977 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.312830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa271f4-d9e8-4f34-b6ea-b3c9e1f84a46 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.318290 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.318939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.319224 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.319495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.320209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.322105 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.348463 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1393/2791] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:20.352751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.362962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053b2a-3a84-4ab7-9ed1-3ba41c2048af admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.425680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.426361 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.426663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.426925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.427625 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.429574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.450676 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1399/2792] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:33:20.455074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.465830 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914bdd-ce18-4c04-b0e8-6cb86387e23d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.471168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.471904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.472183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.472451 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.473174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.474767 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.485487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1394/2793] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:20.489925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.500050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42662b5c-9517-40c2-ba51-06cccbcb83ab admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.504880 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.505508 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.505797 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.506069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.506783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.508395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599b361-9648-46f0-87c4-1f597b839da6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.518557 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1400/2794] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:20.522958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.533324 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5c92-1fa2-4953-9c12-d2aa495a8733 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.538639 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.539530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.539802 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.540099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] PATH_INFO: `/v3/projects/a6c7d99721aa47c2a3a35c7671ddf069/users/48f0bc5bdb824f39b535082ffe37f3bb/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.555283 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c7d99721aa47c2a3a35c7671ddf069, user_id=48f0bc5bdb824f39b535082ffe37f3bb, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.557934 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.572173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1395/2795] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:20 2022] PUT /identity/v3/projects/a6c7d99721aa47c2a3a35c7671ddf069/users/48f0bc5bdb824f39b535082ffe37f3bb/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:20.628782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.629089 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.629370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.656882 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] MFA Rules not processed for user `48f0bc5bdb824f39b535082ffe37f3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:20.658081 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:20.728173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1401/2796] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:20.733028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.814978 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b28d-ec6c-4301-91eb-9cbb0345f741 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.820644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.821293 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.821567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.821833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.822507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.824430 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.852016 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1396/2797] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:20.856183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.867010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d80e4-b076-4190-b7d2-7fa530d90ce6 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.923784 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.924458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.924742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.924980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.925683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.927604 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.949879 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1402/2798] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:20 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:20.953860 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.964372 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9c55-c01b-4be5-abd6-6d9198a81bfa admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:20.969883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:20.970536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:20.970810 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:20.971074 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:20.971815 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:20.973438 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:20.984080 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1397/2799] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:20.988305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:20.998303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572204-05f7-468b-b9b4-20b4eea7b714 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:21.003064 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:21.003980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.004262 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.004534 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] PATH_INFO: `/v3/projects/347bd94d50404583aca60f6d5ffbdc04/users/e0dc373adf924eaaaac8524f1ad295d0/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.018968 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347bd94d50404583aca60f6d5ffbdc04, user_id=e0dc373adf924eaaaac8524f1ad295d0, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:21.021654 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:21.037917 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1403/2800] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:20 2022] PUT /identity/v3/projects/347bd94d50404583aca60f6d5ffbdc04/users/e0dc373adf924eaaaac8524f1ad295d0/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:21.041991 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:21.051900 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e1bd-e37c-4055-9cd2-3f9fb7e166f3 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:21.111313 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:21.111932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.112209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.112483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.113205 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:21.114805 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb39a-1e1b-4a4d-8fa6-ae9cb8a73eb9 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:21.124565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1398/2801] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:21.128877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:21.139421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701ef1-0e09-4cd1-82c3-acd868b7b750 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:21.144571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:21.145447 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.145726 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.145994 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] PATH_INFO: `/v3/projects/347bd94d50404583aca60f6d5ffbdc04/users/e0dc373adf924eaaaac8524f1ad295d0/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.148036 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=347bd94d50404583aca60f6d5ffbdc04, user_id=e0dc373adf924eaaaac8524f1ad295d0, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:21.150689 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:21.160978 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1404/2802] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:21 2022] PUT /identity/v3/projects/347bd94d50404583aca60f6d5ffbdc04/users/e0dc373adf924eaaaac8524f1ad295d0/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:21.171195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.171496 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.171788 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.199333 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] MFA Rules not processed for user `e0dc373adf924eaaaac8524f1ad295d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:21.201424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:21.272248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1399/2803] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:33:21.283979 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:21.285921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:21.344974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c01832-c43c-4aba-a06c-8a9150265aee admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:21.348951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:21.349579 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.349855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.350120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.359228 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:21.360686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:21.370392 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1405/2804] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:21.445995 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:21.455758 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6235-e829-47b5-85f0-b9db973c523c None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:21.459667 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:21.460340 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:21.460619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:21.460890 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:21.526134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:21.527554 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543df9-354e-4098-baac-fb9b63122cfd service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:21.536772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1400/2805] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:31.695086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:31.758760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e55b-1297-41f4-a105-df4e1050d237 service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:31.763901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:31.764767 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:31.765042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:31.765317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] PATH_INFO: `/v3/users/48f0bc5bdb824f39b535082ffe37f3bb` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:31.766533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f0bc5bdb824f39b535082ffe37f3bb)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:31.768599 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:31.824304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f0bc5bdb824f39b535082ffe37f3bb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:31.833611 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f0bc5bdb824f39b535082ffe37f3bb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:31.841105 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f0bc5bdb824f39b535082ffe37f3bb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:31.841825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f0bc5bdb824f39b535082ffe37f3bb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:31.842475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f0bc5bdb824f39b535082ffe37f3bb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:31.860563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1406/2806] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:31 2022] DELETE /identity/v3/users/48f0bc5bdb824f39b535082ffe37f3bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:31.865394 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:31.865925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:31.865925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:31.884092 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:31.885291 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:31.951752 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1401/2807] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:31.961776 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:31.963276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:32.023154 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e816c8-55fc-44c0-930f-0be491988162 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:32.027545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:32.028317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:32.028593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:32.028859 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:32.038252 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:32.039664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:32.049415 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1407/2808] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:32.324392 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:32.326191 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:32.341435 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e79c6-01f5-476e-b758-3f117566bed0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:32.347132 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:32.348117 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:32.348408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:32.348674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] PATH_INFO: `/v3/projects/a6c7d99721aa47c2a3a35c7671ddf069` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:32.349945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c7d99721aa47c2a3a35c7671ddf069)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:32.352073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:32.399286 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c7d99721aa47c2a3a35c7671ddf069', 'request_id': 'req-722f4452-16b8-4289-bad5-a846e950c00c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.407374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c7d99721aa47c2a3a35c7671ddf069', 'request_id': 'req-722f4452-16b8-4289-bad5-a846e950c00c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.413763 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c7d99721aa47c2a3a35c7671ddf069', 'request_id': 'req-722f4452-16b8-4289-bad5-a846e950c00c'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.426197 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] The token cache is being invalidate because project a6c7d99721aa47c2a3a35c7671ddf069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:32.426489 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.427275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.428970 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1402/2809] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:32 2022] DELETE /identity/v3/projects/a6c7d99721aa47c2a3a35c7671ddf069 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:33:32.433012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:32.443317 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916051-19f0-46ca-a4db-07edf5a2dd41 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:32.503248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:32.504255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:32.504530 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:32.504799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] PATH_INFO: `/v3/users/e0dc373adf924eaaaac8524f1ad295d0` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:32.505999 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0dc373adf924eaaaac8524f1ad295d0)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:32.507931 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:32.553721 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0dc373adf924eaaaac8524f1ad295d0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.561255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0dc373adf924eaaaac8524f1ad295d0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.568407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0dc373adf924eaaaac8524f1ad295d0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.569039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0dc373adf924eaaaac8524f1ad295d0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.569639 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-16f116fb-852a-4200-9d0a-5fc2c7a4456a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0dc373adf924eaaaac8524f1ad295d0'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.586919 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1408/2810] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:32 2022] DELETE /identity/v3/users/e0dc373adf924eaaaac8524f1ad295d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:32.856320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:32.857737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:32.876555 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4452-16b8-4289-bad5-a846e950c00c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:32.933961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:32.934796 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:32.935073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:32.935344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] PATH_INFO: `/v3/projects/347bd94d50404583aca60f6d5ffbdc04` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:32.936531 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=347bd94d50404583aca60f6d5ffbdc04)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:32.938448 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:32.989365 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347bd94d50404583aca60f6d5ffbdc04', 'request_id': 'req-2fc7f647-90d7-4287-95d6-f243a0c41eff'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:32.998248 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347bd94d50404583aca60f6d5ffbdc04', 'request_id': 'req-2fc7f647-90d7-4287-95d6-f243a0c41eff'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:33.004018 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347bd94d50404583aca60f6d5ffbdc04', 'request_id': 'req-2fc7f647-90d7-4287-95d6-f243a0c41eff'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:33.014922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] The token cache is being invalidate because project 347bd94d50404583aca60f6d5ffbdc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:33.015207 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:33.015883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-2fc7f647-90d7-4287-95d6-f243a0c41eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:33.017450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1403/2811] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:32 2022] DELETE /identity/v3/projects/347bd94d50404583aca60f6d5ffbdc04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:33.022649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.023178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.023178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.041160 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:33.042359 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:33.103421 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1409/2812] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:33.112937 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.113220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.113491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.132737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:33.133939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:33.142341 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1404/2813] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:33.146842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.156861 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0bac8-2023-4c26-a5f1-d0cfb681446c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.162618 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.163574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.164041 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.164482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.165515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:33:33.165952 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.168533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.180545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1410/2814] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:33:33.185156 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.195134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb8e04-ad72-4a4a-bf10-aea474a61ace None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.202408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.203088 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.203364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.203635 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.204370 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.206332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.238209 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1405/2815] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:33.244607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.260806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ad14e-262d-4841-99d0-06b1275a8fc4 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.318210 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.318877 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.319166 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.319443 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.320193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.322120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.348864 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1411/2816] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:33.353235 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.363565 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29eeda-f82a-408f-ae8f-efd450b04da8 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.368301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.368950 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.369226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.369495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.370211 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.371856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.382081 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1406/2817] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:33.386396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.397000 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9122-120e-4151-88a8-71d94556c8b5 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.402445 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.403125 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.403440 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.403751 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.404580 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.406383 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c556ec5-490c-400e-bd9c-d037d7743852 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.416912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1412/2818] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:33.421226 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.431320 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96f93c-f96a-4d73-a27d-bc67d4d2c109 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.436589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.437414 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.437699 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.438026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] PATH_INFO: `/v3/projects/89d265f73b3949a59c3fbbd1535bf233/users/738f3977b9aa45eebbbf6759fd2f539e/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.454275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d265f73b3949a59c3fbbd1535bf233, user_id=738f3977b9aa45eebbbf6759fd2f539e, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.456962 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.471755 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1407/2819] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:33 2022] PUT /identity/v3/projects/89d265f73b3949a59c3fbbd1535bf233/users/738f3977b9aa45eebbbf6759fd2f539e/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:33.482234 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.482545 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.482842 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.510201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] MFA Rules not processed for user `738f3977b9aa45eebbbf6759fd2f539e`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:33.511424 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:33.578476 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1413/2820] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:33:33.583113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.645783 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb582-115f-487d-b129-6be5fbec1f82 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.651658 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.652344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.652619 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.652893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.653664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.655572 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.681956 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1408/2821] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:33.686153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.697408 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3791-9cc4-43c3-b82e-33531be5e183 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.755088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.755758 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.756078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.756356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.757055 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.758973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.779669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1414/2822] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:33 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:33:33.783727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.797168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaad84-f619-48e6-96b2-ffd6e58de177 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.803330 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.804441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.804441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.804759 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.805418 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.807091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.818766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1409/2823] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:33.823095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.833369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678a7a-7d70-4e65-b6fa-556c50bd2190 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.838402 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.839282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.839561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.839867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] PATH_INFO: `/v3/projects/24a719a39dee462987eecdae6b2754b8/users/336c416405c7490eaaae3ec483cbc728/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.855340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a719a39dee462987eecdae6b2754b8, user_id=336c416405c7490eaaae3ec483cbc728, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.858067 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.872542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1415/2824] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:33 2022] PUT /identity/v3/projects/24a719a39dee462987eecdae6b2754b8/users/336c416405c7490eaaae3ec483cbc728/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:33.876583 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.886450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3552-5458-4acb-ad7a-82997c5a8513 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.942645 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.943309 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.943585 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.943887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.944600 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.946195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93419e00-e333-48f5-94b2-29c75633cf3d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.956346 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1410/2825] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:33.960668 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:33.970916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4783-7297-4f3b-97d7-cab10c30d485 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:33.975655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:33.976624 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:33.976903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:33.977173 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] PATH_INFO: `/v3/projects/24a719a39dee462987eecdae6b2754b8/users/336c416405c7490eaaae3ec483cbc728/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:33.979148 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a719a39dee462987eecdae6b2754b8, user_id=336c416405c7490eaaae3ec483cbc728, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:33.981914 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:33.992093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1416/2826] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:33 2022] PUT /identity/v3/projects/24a719a39dee462987eecdae6b2754b8/users/336c416405c7490eaaae3ec483cbc728/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:34.003306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:34.003591 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:34.003914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:34.029994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] MFA Rules not processed for user `336c416405c7490eaaae3ec483cbc728`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:34.031225 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:34.101362 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1411/2827] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:33:34.112690 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:34.114921 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:34.174378 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00503c0-6a73-4500-bc20-6f1ab626beb3 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:34.178256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:34.178901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:34.179176 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:34.179449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:34.188847 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:34.190610 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a849-96bc-458d-aba6-17b070f6f91b service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:34.200521 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1417/2828] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:34.747227 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:34.809833 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8e16b-88ac-4167-ad09-6ab072cf6f89 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:34.814663 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:34.815945 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:34.816221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:34.816483 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] PATH_INFO: `/v3/users/738f3977b9aa45eebbbf6759fd2f539e` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:34.817675 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738f3977b9aa45eebbbf6759fd2f539e)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:34.819596 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:34.865375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738f3977b9aa45eebbbf6759fd2f539e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:34.866007 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738f3977b9aa45eebbbf6759fd2f539e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:34.866664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738f3977b9aa45eebbbf6759fd2f539e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:34.879059 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738f3977b9aa45eebbbf6759fd2f539e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:34.887718 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738f3977b9aa45eebbbf6759fd2f539e'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:34.900210 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1412/2829] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:34 2022] DELETE /identity/v3/users/738f3977b9aa45eebbbf6759fd2f539e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:34.904990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:34.905340 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:34.905634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:34.922957 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:34.924237 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:34.986452 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1418/2830] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:34.996110 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:34.997646 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:35.057375 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778546-6f06-4840-85e8-0f777ffc5050 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:35.061528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:35.062214 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:35.062524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:35.062816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:35.073664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:35.075140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:35.084597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1413/2831] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:35.360910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:35.362568 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:35.375423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937931-2426-40a4-83d0-6b5d3f8a3b40 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:35.381202 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:35.382368 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:35.382657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:35.382898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] PATH_INFO: `/v3/projects/89d265f73b3949a59c3fbbd1535bf233` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:35.384308 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d265f73b3949a59c3fbbd1535bf233)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:35.386315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:35.436040 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d265f73b3949a59c3fbbd1535bf233', 'request_id': 'req-e0508fed-3e66-4702-9760-7b7bd61c483c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.442730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d265f73b3949a59c3fbbd1535bf233', 'request_id': 'req-e0508fed-3e66-4702-9760-7b7bd61c483c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.450912 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d265f73b3949a59c3fbbd1535bf233', 'request_id': 'req-e0508fed-3e66-4702-9760-7b7bd61c483c'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.461981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] The token cache is being invalidate because project 89d265f73b3949a59c3fbbd1535bf233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:35.462271 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.462920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.464598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1419/2832] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:35 2022] DELETE /identity/v3/projects/89d265f73b3949a59c3fbbd1535bf233 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:35.468932 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:35.479332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51883-0157-40ea-8654-49a54cff6781 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:35.536052 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:35.536831 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:35.537106 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:35.537374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] PATH_INFO: `/v3/users/336c416405c7490eaaae3ec483cbc728` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:35.538626 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336c416405c7490eaaae3ec483cbc728)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:35.540656 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:35.598107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336c416405c7490eaaae3ec483cbc728'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.598742 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336c416405c7490eaaae3ec483cbc728'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.599367 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336c416405c7490eaaae3ec483cbc728'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.615644 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336c416405c7490eaaae3ec483cbc728'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.627813 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-30f933cd-5d10-4baa-a54c-1c15ea4cef08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336c416405c7490eaaae3ec483cbc728'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:35.640310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1414/2833] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:35 2022] DELETE /identity/v3/users/336c416405c7490eaaae3ec483cbc728 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:33:35.909980 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:35.911660 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:35.924276 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508fed-3e66-4702-9760-7b7bd61c483c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:35.981863 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:35.982722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:35.982986 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:35.983255 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] PATH_INFO: `/v3/projects/24a719a39dee462987eecdae6b2754b8` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:35.984542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a719a39dee462987eecdae6b2754b8)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:35.986512 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.031760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a719a39dee462987eecdae6b2754b8', 'request_id': 'req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:36.037264 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a719a39dee462987eecdae6b2754b8', 'request_id': 'req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:36.045908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a719a39dee462987eecdae6b2754b8', 'request_id': 'req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:36.057432 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] The token cache is being invalidate because project 24a719a39dee462987eecdae6b2754b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:36.057722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:36.058432 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-7831b2b8-fe1d-45c9-b923-95b715c3e7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:36.060164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1420/2834] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:35 2022] DELETE /identity/v3/projects/24a719a39dee462987eecdae6b2754b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:36.065631 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.066238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.066238 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.084347 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:36.085547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:36.145268 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1415/2835] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:36.153094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.153396 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.153655 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.172555 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:36.173755 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:36.182213 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1421/2836] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:36.186678 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.197026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59490b55-4d5e-4b58-a3fa-701d5d13e036 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.202737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.203421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.203700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.204169 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.204720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:33:36.205027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.206654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.219206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1416/2837] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:33:36.223792 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.233314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbbc97-fa95-4006-9575-aef1fc539f3c None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.238854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.239507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.239806 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.240088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.240771 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.242679 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.268750 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1422/2838] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:36 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:36.273031 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.283527 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bc24-db61-4a4e-8136-d84b78641e38 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.340822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.341409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.341692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.341963 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.342641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.344627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.365361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1417/2839] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:36 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:36.369571 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.379664 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02150c1-bdaa-40d0-907f-8d89f98e9f31 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.384696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.385348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.385628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.385899 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.386635 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.388280 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.399029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1423/2840] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:36.403204 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.414232 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695046-b896-4d31-b596-52269b94b223 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.419961 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.420630 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.420912 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.421187 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.421914 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.423522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2978b1-c06d-4a16-a7d8-a7720bb95834 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.434476 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1418/2841] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:36.438862 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.449894 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397fdb-ad30-4cb0-9f49-497465bd18de admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.455940 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.456829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.457094 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.457369 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] PATH_INFO: `/v3/projects/3aa95fb5bac841ee97942e3156710ff6/users/a3229ac84c494a2282abb1f49ee41269/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.474710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa95fb5bac841ee97942e3156710ff6, user_id=a3229ac84c494a2282abb1f49ee41269, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.477463 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.490737 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1424/2842] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:36 2022] PUT /identity/v3/projects/3aa95fb5bac841ee97942e3156710ff6/users/a3229ac84c494a2282abb1f49ee41269/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:36.501079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.501409 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.501707 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.529099 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] MFA Rules not processed for user `a3229ac84c494a2282abb1f49ee41269`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:36.530303 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:36.596516 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1419/2843] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:36.607944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:36.609884 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:36.668226 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db87b-5d71-42ad-b686-a2dd3d8c2812 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:36.672692 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dbe9ca0c3f4d37906a4a42c6e45545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:36.674069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:36.674069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:36.674069 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:36.683741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:36.685321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204e41-d38e-4595-9c85-488b04c1f531 service glance] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:36.694910 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1425/2844] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:33:53.206300 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:53.272491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23e4a-1fab-4c5e-ab8c-82ad27ab8259 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:53.277723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:53.278637 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:53.278913 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:53.279184 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] PATH_INFO: `/v3/users/a3229ac84c494a2282abb1f49ee41269` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:53.280440 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3229ac84c494a2282abb1f49ee41269)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:53.282364 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:53.330188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3229ac84c494a2282abb1f49ee41269'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.330906 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3229ac84c494a2282abb1f49ee41269'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.331618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3229ac84c494a2282abb1f49ee41269'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.344570 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3229ac84c494a2282abb1f49ee41269'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.353452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3229ac84c494a2282abb1f49ee41269'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.366045 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1420/2845] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:33:53 2022] DELETE /identity/v3/users/a3229ac84c494a2282abb1f49ee41269 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:53.370808 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:53.371339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:53.371339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:53.392393 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:53.393663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:53.465505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1426/2846] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:53.475508 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:53.477142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:53.534618 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88517de-f522-47fe-9dd5-332df4f031d2 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:53.539354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:53.540174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:53.540421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:53.540687 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:53.551576 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:53.553113 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70326c-cd97-4dbe-a7c2-b71a0fb5d23a service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:53.563439 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1421/2847] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:53.830090 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:53.831564 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:53.843977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2e20-5652-4574-a6c7-6f6c58f428bb None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:53.849867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:53.850748 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:53.851051 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:53.851294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] PATH_INFO: `/v3/projects/3aa95fb5bac841ee97942e3156710ff6` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:53.852637 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa95fb5bac841ee97942e3156710ff6)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:53.854665 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:53.904482 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa95fb5bac841ee97942e3156710ff6', 'request_id': 'req-3782a531-4e19-4e38-89bd-bb1618a6cbfb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.909933 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa95fb5bac841ee97942e3156710ff6', 'request_id': 'req-3782a531-4e19-4e38-89bd-bb1618a6cbfb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.919319 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa95fb5bac841ee97942e3156710ff6', 'request_id': 'req-3782a531-4e19-4e38-89bd-bb1618a6cbfb'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.930458 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] The token cache is being invalidate because project 3aa95fb5bac841ee97942e3156710ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:33:53.930743 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.931375 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-3782a531-4e19-4e38-89bd-bb1618a6cbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:33:53.932951 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1427/2848] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:33:53 2022] DELETE /identity/v3/projects/3aa95fb5bac841ee97942e3156710ff6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:53.937948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:53.938241 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:53.938575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:53.956888 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:53.958114 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:54.021179 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1422/2849] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:54.030373 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.030609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.030916 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.050782 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:54.052031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:54.061149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1428/2850] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:54.066003 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.076387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff297-e1fc-47a7-a464-eaf486299110 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.081709 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.082368 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.082642 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.082910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.083622 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:33:54.083954 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.085547 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.097522 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1423/2851] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:33:54.101981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.111495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c59df6-eb0c-4584-904b-be57c8f70725 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.116328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.116974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.117249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.117519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.118230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.120132 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.149339 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1429/2852] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:33:54 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:54.153797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.164887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dbbd-7ffd-4608-94e9-43612d3dd7f6 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.220901 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.221573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.221849 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.222116 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.222797 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.224734 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.245382 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1424/2853] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:33:54 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:33:54.249595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.259965 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5881df-7349-423b-97f9-9fe987302c94 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.265602 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.266291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.266569 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.266840 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.267566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.269212 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.280612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1430/2854] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:54.284778 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.294984 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce4e5-71e8-42ae-bb16-6d82aa181d26 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.300050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.300697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.301025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.301361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.302183 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.303826 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86a28d-b9bc-4556-94f9-beaad4e63e84 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.313969 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1425/2855] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:33:54.318558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.328468 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2bec-b983-4bf8-a529-cf276a2c5195 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.333854 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.334736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.335021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.335294 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] PATH_INFO: `/v3/projects/ecbb0377a9684d83a2ab278042042409/users/247d9df50860491ba6e58dd368b2ff57/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.350047 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbb0377a9684d83a2ab278042042409, user_id=247d9df50860491ba6e58dd368b2ff57, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.352736 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.366554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1431/2856] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:33:54 2022] PUT /identity/v3/projects/ecbb0377a9684d83a2ab278042042409/users/247d9df50860491ba6e58dd368b2ff57/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:33:54.377026 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.377316 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.377664 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.405048 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] MFA Rules not processed for user `247d9df50860491ba6e58dd368b2ff57`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:54.406253 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:54.471884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1426/2857] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:33:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:54.483628 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:54.485839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:54.541434 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b729e-8636-4ea7-80c6-4aa1133c65dc admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:54.545475 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:54.546129 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:54.546382 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:54.546682 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:54.556073 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:54.557507 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee57df2-684a-4e37-bf3a-a0502bcf40dc service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:54.567063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1432/2858] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:33:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:14.140064 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:14.207559 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd759bd-6b6f-43fd-b8ad-0cad312f909a None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:14.213402 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:14.214294 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.214573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.214843 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] PATH_INFO: `/v3/users/247d9df50860491ba6e58dd368b2ff57` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.216354 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247d9df50860491ba6e58dd368b2ff57)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:14.218305 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:14.267393 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247d9df50860491ba6e58dd368b2ff57'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.268134 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247d9df50860491ba6e58dd368b2ff57'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.268949 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247d9df50860491ba6e58dd368b2ff57'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.281194 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247d9df50860491ba6e58dd368b2ff57'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.289557 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247d9df50860491ba6e58dd368b2ff57'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.304567 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1427/2859] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:34:14 2022] DELETE /identity/v3/users/247d9df50860491ba6e58dd368b2ff57 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:14.309503 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.310086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.310086 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.328920 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:14.330147 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:14.391813 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1433/2860] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:14.401841 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:14.403282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:14.458730 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee88ac-ce4b-4b15-8f06-9961611aee17 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:14.462777 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:14.463417 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.463700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.464010 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.473760 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:14.475257 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a2f61-e864-49da-bf01-1710892fe70b service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:14.485467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1428/2861] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:14.747420 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:14.748935 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:14.761193 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e81d9-4f47-4acb-b415-41f7b5f48e51 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:14.766829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:14.767677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.768007 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.768283 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] PATH_INFO: `/v3/projects/ecbb0377a9684d83a2ab278042042409` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.770093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbb0377a9684d83a2ab278042042409)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:14.772230 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:14.822944 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbb0377a9684d83a2ab278042042409', 'request_id': 'req-bf9d1364-315a-48b1-85c0-23fe7c1a205b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.828253 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbb0377a9684d83a2ab278042042409', 'request_id': 'req-bf9d1364-315a-48b1-85c0-23fe7c1a205b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.836107 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbb0377a9684d83a2ab278042042409', 'request_id': 'req-bf9d1364-315a-48b1-85c0-23fe7c1a205b'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.849329 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] The token cache is being invalidate because project ecbb0377a9684d83a2ab278042042409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:34:14.849631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.850275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bf9d1364-315a-48b1-85c0-23fe7c1a205b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:14.851876 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1434/2862] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:34:14 2022] DELETE /identity/v3/projects/ecbb0377a9684d83a2ab278042042409 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:14.857790 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.858079 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.858385 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.876166 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:14.877356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:14.943133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1429/2863] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:14.951043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:14.951331 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:14.951609 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:14.972573 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:14.973829 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:14.983227 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1435/2864] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:14.987740 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:14.997924 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceee23-840c-4c7b-bd6a-2a0b2439b57e None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.003245 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.003931 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.004206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.004472 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.005185 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:34:15.005481 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.007086 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.018766 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1430/2865] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:34:15.023179 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.032898 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803abdf-b958-4a51-94f6-7b21a7cd8583 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.038783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.039433 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.039711 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.040011 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.040700 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.042657 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.071248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1436/2866] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:15.075478 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.085497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617cef9-e79f-4b89-b3bb-eb24ec87ffd8 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.142491 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.143168 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.143406 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.143683 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.144513 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.146426 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.167094 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1431/2867] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:34:15.172742 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.183122 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62b52-95f0-4c56-a70b-fc5e3aeffbd7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.187977 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.188627 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.189316 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.189590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.190312 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.191936 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.202153 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1437/2868] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:15.206314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.216702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15b67-8459-4fe3-a9b8-92178efd7e2e admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.221801 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.222458 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.222736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.223011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.223726 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.225343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33667f-f11e-4e4d-99f9-8c62c20f2e88 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.235353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1432/2869] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:15.239593 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.249436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56825-dc52-4b21-85e3-f9eb6930b477 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.255201 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.256330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.256649 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.256929 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] PATH_INFO: `/v3/projects/9de26a92faa34284bc2af6b084148e59/users/dbd740e2478445c9943ae85940957bec/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.271623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de26a92faa34284bc2af6b084148e59, user_id=dbd740e2478445c9943ae85940957bec, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.274409 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.288622 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1438/2870] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:15 2022] PUT /identity/v3/projects/9de26a92faa34284bc2af6b084148e59/users/dbd740e2478445c9943ae85940957bec/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:15.298756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.299041 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.299310 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.325935 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] MFA Rules not processed for user `dbd740e2478445c9943ae85940957bec`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:15.327050 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:15.393379 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1433/2871] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:15.398120 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.458906 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e05866-e2c8-45fa-a6b2-8c34ba546622 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.464087 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.464732 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.465010 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.465282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.466030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.467948 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.499152 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1439/2872] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:15.503948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.514973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ed9e-37a2-4d3d-9fd8-119b91e73476 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.577654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.578220 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.578490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.578756 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.579452 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.581421 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.603623 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1434/2873] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:15.607983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.618686 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c7ae-0c1b-4a50-8d53-ec844bb619cb admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.623900 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.624556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.624839 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.625117 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.625849 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.627449 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.638642 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1440/2874] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:15.643020 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.654133 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4b16-6a3c-4eeb-8911-55a85d4818a4 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.660104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.660762 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.661033 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.661280 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.661994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.663590 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346a760-72e0-414e-b22f-0ec44226ffde admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.674103 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1435/2875] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:15.678693 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.689786 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98b87-d5d9-4ff7-8ce6-ae909f180e3d admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.695139 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.696060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.696336 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.696600 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] PATH_INFO: `/v3/projects/7c4b9f5c995347c0898595c45258b635/users/13dce48e0a8e487d8444ccf1c32a6604/roles/22c100d842ea400285feca8a56b61095` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.712669 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b9f5c995347c0898595c45258b635, user_id=13dce48e0a8e487d8444ccf1c32a6604, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.715304 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.729309 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1441/2876] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:15 2022] PUT /identity/v3/projects/7c4b9f5c995347c0898595c45258b635/users/13dce48e0a8e487d8444ccf1c32a6604/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:15.739986 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.740298 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.740568 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.768617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] MFA Rules not processed for user `13dce48e0a8e487d8444ccf1c32a6604`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:15.769837 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:15.836866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1436/2877] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:15.841504 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.906926 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81b83-25a1-406a-949a-5c661c831879 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:15.912441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:15.913078 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:15.913386 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:15.913650 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:15.914388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:15.916330 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:15.945196 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1442/2878] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:15.949764 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:15.962254 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102053b-85a6-4385-a4c9-b56e714a1d11 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.022774 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.023444 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.023721 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.024025 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] PATH_INFO: `/v3/users` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.024712 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.026607 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.048747 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1437/2879] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:34:15 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:34:16.052872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:16.064764 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df5a-602d-45cf-b49e-1a56cc342d71 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.070783 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.071672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.071993 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.072268 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.072991 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.074590 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.086567 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1443/2880] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:16.091159 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:16.101617 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823c7f-2a11-4f5c-8039-b6e4ecf4589c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.107680 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.108603 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.108864 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.109160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] PATH_INFO: `/v3/projects/cab291c5ddab40029e063220b21e76c5/users/8fc488713e624f888faa418d97eb1448/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.125976 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab291c5ddab40029e063220b21e76c5, user_id=8fc488713e624f888faa418d97eb1448, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.128823 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.145467 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1438/2881] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:16 2022] PUT /identity/v3/projects/cab291c5ddab40029e063220b21e76c5/users/8fc488713e624f888faa418d97eb1448/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:16.149705 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:16.160423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29420be-a536-4502-844a-ed28528b5cc9 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.220561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.221239 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.221526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.221802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.222533 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.224183 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d0d7b-6430-4139-8aa3-417cb7b48758 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.234275 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1444/2882] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:16.238659 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:16.250750 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565e4d-d8b5-4f05-8f27-1918e0f1128d admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.256704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.258199 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.258641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.259123 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] PATH_INFO: `/v3/projects/cab291c5ddab40029e063220b21e76c5/users/8fc488713e624f888faa418d97eb1448/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.261772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab291c5ddab40029e063220b21e76c5, user_id=8fc488713e624f888faa418d97eb1448, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.264487 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.275299 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1439/2883] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:16 2022] PUT /identity/v3/projects/cab291c5ddab40029e063220b21e76c5/users/8fc488713e624f888faa418d97eb1448/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:16.287106 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.287370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.287672 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.315435 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] MFA Rules not processed for user `8fc488713e624f888faa418d97eb1448`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:16.316680 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:16.387188 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1445/2884] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:16.398884 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:16.400772 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:16.458737 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2626-b84f-4ebf-bf74-adda16fb4505 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:16.462838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:16.463490 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:16.463824 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:16.464102 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:16.522142 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:16.523575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:16.532573 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1440/2885] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:18.038987 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:18.040619 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:18.055595 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18f8a-b172-49f2-9410-a099792fc6bd None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:18.060485 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:18.061410 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:18.061774 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:18.061971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:18.122958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:18.124348 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:18.133494 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1446/2886] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:18.671575 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:18.680910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b809e-308b-4405-b1ad-1ea8ebd07b8d service cinder] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:18.685703 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d44d26a512a4a92806e60f3cb10dd33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:18.686356 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:18.686633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:18.687091 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:18.698173 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:18.699700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57607f-e983-4ac7-a59f-5058f74e106b service cinder] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:18.710325 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1441/2887] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:22.606888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:22.672710 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d7dc-e08b-4e36-9741-8e1832fba53d service cinder] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:22.677429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:22.678328 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:22.678601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:22.678874 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] PATH_INFO: `/v3/users/dbd740e2478445c9943ae85940957bec` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:22.680314 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd740e2478445c9943ae85940957bec)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:22.682021 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:22.735712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd740e2478445c9943ae85940957bec'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:22.744133 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd740e2478445c9943ae85940957bec'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:22.751225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd740e2478445c9943ae85940957bec'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:22.751983 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd740e2478445c9943ae85940957bec'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:22.752633 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd740e2478445c9943ae85940957bec'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:22.770531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1447/2888] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:34:22 2022] DELETE /identity/v3/users/dbd740e2478445c9943ae85940957bec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:22.775143 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:22.775633 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:22.775799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:22.799662 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:22.800816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:22.865691 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1442/2889] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:22.875958 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:22.877515 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:22.939893 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d961f-5eee-4527-bafb-09d5d2779aa4 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:22.944172 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:22.944845 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:22.945111 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:22.945381 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:22.955825 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:22.958103 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:22.970397 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1448/2890] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:23.260988 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:23.265063 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:23.281343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c603-ee06-433d-b062-de16b11607d3 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:23.287700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:23.288641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:23.288943 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:23.289219 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] PATH_INFO: `/v3/projects/9de26a92faa34284bc2af6b084148e59` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:23.290571 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de26a92faa34284bc2af6b084148e59)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:23.292670 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:23.342798 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de26a92faa34284bc2af6b084148e59', 'request_id': 'req-260d0005-2ebe-417f-84f0-3a3471d6f7cd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.351225 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de26a92faa34284bc2af6b084148e59', 'request_id': 'req-260d0005-2ebe-417f-84f0-3a3471d6f7cd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.357221 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de26a92faa34284bc2af6b084148e59', 'request_id': 'req-260d0005-2ebe-417f-84f0-3a3471d6f7cd'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.369983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] The token cache is being invalidate because project 9de26a92faa34284bc2af6b084148e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:34:23.370256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.370965 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.372649 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1443/2891] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:34:23 2022] DELETE /identity/v3/projects/9de26a92faa34284bc2af6b084148e59 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:23.376962 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:23.387469 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189f1b-daad-491f-8fc0-a7979e43b552 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:23.444093 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:23.444925 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:23.445200 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:23.445489 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] PATH_INFO: `/v3/users/13dce48e0a8e487d8444ccf1c32a6604` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:23.446821 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dce48e0a8e487d8444ccf1c32a6604)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:23.448891 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:23.503563 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dce48e0a8e487d8444ccf1c32a6604'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.512203 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dce48e0a8e487d8444ccf1c32a6604'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.520099 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dce48e0a8e487d8444ccf1c32a6604'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.520897 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dce48e0a8e487d8444ccf1c32a6604'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.521683 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dce48e0a8e487d8444ccf1c32a6604'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.539371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1449/2892] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:34:23 2022] DELETE /identity/v3/users/13dce48e0a8e487d8444ccf1c32a6604 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:23.820825 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:23.822724 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:23.840494 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0005-2ebe-417f-84f0-3a3471d6f7cd admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:23.905904 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:23.906895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:23.907216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:23.907521 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] PATH_INFO: `/v3/projects/7c4b9f5c995347c0898595c45258b635` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:23.909061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4b9f5c995347c0898595c45258b635)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:23.911061 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:23.964795 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4b9f5c995347c0898595c45258b635', 'request_id': 'req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.974326 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4b9f5c995347c0898595c45258b635', 'request_id': 'req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.979958 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4b9f5c995347c0898595c45258b635', 'request_id': 'req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.990893 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] The token cache is being invalidate because project 7c4b9f5c995347c0898595c45258b635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:34:23.991172 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.991820 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:23.993396 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1444/2893] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:34:23 2022] DELETE /identity/v3/projects/7c4b9f5c995347c0898595c45258b635 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:23.997596 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.002945 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:24.016631 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb8d6-f0b9-470c-b09c-0e999bb1653c admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.080546 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.081439 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.081722 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.082002 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] PATH_INFO: `/v3/users/8fc488713e624f888faa418d97eb1448` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.083405 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc488713e624f888faa418d97eb1448)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.085671 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.135303 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc488713e624f888faa418d97eb1448'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.142659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc488713e624f888faa418d97eb1448'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.149885 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc488713e624f888faa418d97eb1448'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.150574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc488713e624f888faa418d97eb1448'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.151218 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-f86c2e45-f20d-460c-bb89-b5720ff129a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc488713e624f888faa418d97eb1448'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.168556 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1450/2894] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:34:23 2022] DELETE /identity/v3/users/8fc488713e624f888faa418d97eb1448 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:24.455875 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.457835 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:24.476174 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a06a7-cddb-43d4-b9a8-f26ec3eaa852 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.542929 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.543994 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.544275 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.544528 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] PATH_INFO: `/v3/projects/cab291c5ddab40029e063220b21e76c5` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.545895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab291c5ddab40029e063220b21e76c5)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.547822 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.593654 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab291c5ddab40029e063220b21e76c5', 'request_id': 'req-5baadf56-a9c0-422d-ae14-1f77401ef055'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.601769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab291c5ddab40029e063220b21e76c5', 'request_id': 'req-5baadf56-a9c0-422d-ae14-1f77401ef055'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.607236 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab291c5ddab40029e063220b21e76c5', 'request_id': 'req-5baadf56-a9c0-422d-ae14-1f77401ef055'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.618530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] The token cache is being invalidate because project cab291c5ddab40029e063220b21e76c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:34:24.618817 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.619542 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-5baadf56-a9c0-422d-ae14-1f77401ef055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:24.621229 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1445/2895] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:34:24 2022] DELETE /identity/v3/projects/cab291c5ddab40029e063220b21e76c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:24.626577 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.626867 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.627149 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.646601 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:24.647799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:24.710281 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1451/2896] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:24.718323 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.718608 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.718885 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.737260 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:24.738475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:24.746595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1446/2897] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:24.751164 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.761942 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab51248-541c-4a23-95a5-048234c3a2b4 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.767088 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.767746 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.768050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.768321 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] PATH_INFO: `/v3/domains` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.769048 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:34:24.769346 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.771474 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.784728 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1452/2898] 10.222.0.11 () {58 vars in 1152 bytes} [Tue May 3 09:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:34:24.789216 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.798459 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0350c-188b-44d7-b60b-f5a185e4e2cd None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.803509 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.804188 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.804497 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.804768 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.805453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.807358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.836157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1447/2899] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:34:24 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:24.840519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.850789 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98e3c-718a-4b53-ad05-99107e76c228 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.911030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.911712 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.912028 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.912305 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.913008 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.915050 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.937246 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1453/2900] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:34:24 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:24.941827 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.953104 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19a33-df32-4732-ba53-d3f3b14402ad admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.959344 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.960157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.960549 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.960939 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.962302 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.964523 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:24.976107 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1448/2901] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:24.980406 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:24.990607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad3c0f-b6f9-45bc-89ff-b360650623a1 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:24.995603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:24.996695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:24.996695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:24.996927 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] PATH_INFO: `/v3/roles` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:24.997663 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:24.999282 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b82fec-9eee-453a-86e6-bb0eee00c765 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:25.011558 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1454/2902] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:25.016717 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:25.030441 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45e090-1996-431e-9df0-b9bafdb59e07 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:25.038306 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:25.039200 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:25.039485 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:25.039761 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] PATH_INFO: `/v3/projects/653db297f7174d809801b3687717832b/users/9f78486cf7a74b068d83bf755edee919/roles/22c100d842ea400285feca8a56b61095` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:25.055697 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653db297f7174d809801b3687717832b, user_id=9f78486cf7a74b068d83bf755edee919, role_id=22c100d842ea400285feca8a56b61095)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:25.058353 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:25.074427 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1449/2903] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:25 2022] PUT /identity/v3/projects/653db297f7174d809801b3687717832b/users/9f78486cf7a74b068d83bf755edee919/roles/22c100d842ea400285feca8a56b61095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:25.080509 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dfd1-c736-4588-9cd0-195a2aca8f97 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:25.080895 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dfd1-c736-4588-9cd0-195a2aca8f97 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:25.081207 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dfd1-c736-4588-9cd0-195a2aca8f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:25.099606 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-f2e8dfd1-c736-4588-9cd0-195a2aca8f97 None None] MFA Rules not processed for user `155689b863d044f782598840d769a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:25.100856 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-f2e8dfd1-c736-4588-9cd0-195a2aca8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:25.166070 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1455/2904] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:25.176862 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:25.179586 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:25.240606 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80cd66-6dd1-455a-b94f-cb683473f9d5 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:25.244515 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:25.245157 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:25.245436 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:25.245690 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:25.254866 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:25.256343 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:25.265982 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1450/2905] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:29.770456 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:29.771167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:29.771167 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:29.800541 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] MFA Rules not processed for user `9f78486cf7a74b068d83bf755edee919`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:29.801871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:29.878651 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1456/2906] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:29.883530 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:29.895095 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cef3-14cb-4b25-9784-641d1c8de102 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:29.902854 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:29.903524 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:29.904065 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:29.904342 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] PATH_INFO: `/v3/projects` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:29.905240 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:29.907332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:29.943484 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1451/2907] 10.222.0.11 () {60 vars in 1152 bytes} [Tue May 3 09:34:29 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:29.947442 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:29.959451 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57167-0ae8-4feb-a1d7-dc375d2adf01 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:30.034741 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:30.037971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:30.037971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:30.037971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:30.037971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:30.038688 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:30.060696 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1457/2908] 10.222.0.11 () {60 vars in 1143 bytes} [Tue May 3 09:34:29 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:34:30.065408 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:30.076627 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b6b7e-98b3-45c1-9008-f2315839b13c admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:30.081925 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:30.082589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:30.082895 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:30.083161 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:30.083910 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:30.085512 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:30.096858 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1452/2909] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:30.101137 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:30.111724 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438685-bf87-4049-ace8-562a614a5eb7 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:30.116881 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:30.117730 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:30.118005 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:30.118302 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] PATH_INFO: `/v3/projects/3ea569abe3244544a7403a28e32ce103/users/21e57dc843f34a60a726bbba60e56962/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:30.136029 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea569abe3244544a7403a28e32ce103, user_id=21e57dc843f34a60a726bbba60e56962, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:30.139498 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:30.155436 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1458/2910] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:30 2022] PUT /identity/v3/projects/3ea569abe3244544a7403a28e32ce103/users/21e57dc843f34a60a726bbba60e56962/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:30.159784 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:30.171155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacfebe-813d-467c-bac5-abe10d5f7182 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:30.234536 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:30.235217 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:30.235495 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:30.235799 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:30.236532 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:30.238122 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec353-c71b-4aa8-9c3a-1d419bc3ad36 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:30.248735 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1453/2911] 10.222.0.11 () {58 vars in 1121 bytes} [Tue May 3 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:34:30.255232 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:30.267677 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260853e-0f4f-4ef2-adf3-94e1dcd67a64 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:30.273083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:30.273971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:30.274243 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:30.274519 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] PATH_INFO: `/v3/projects/3ea569abe3244544a7403a28e32ce103/users/21e57dc843f34a60a726bbba60e56962/roles/40264f46cb744114a960ef46085a53c3` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:30.276607 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea569abe3244544a7403a28e32ce103, user_id=21e57dc843f34a60a726bbba60e56962, role_id=40264f46cb744114a960ef46085a53c3)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:30.279211 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:30.290574 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1459/2912] 10.222.0.11 () {60 vars in 1482 bytes} [Tue May 3 09:34:30 2022] PUT /identity/v3/projects/3ea569abe3244544a7403a28e32ce103/users/21e57dc843f34a60a726bbba60e56962/roles/40264f46cb744114a960ef46085a53c3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:34.559361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04790-afdf-49af-b9ef-9e82187eef5d None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:34.560296 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04790-afdf-49af-b9ef-9e82187eef5d None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:34.560546 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04790-afdf-49af-b9ef-9e82187eef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:34.592450 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-afc04790-afdf-49af-b9ef-9e82187eef5d None None] MFA Rules not processed for user `21e57dc843f34a60a726bbba60e56962`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:34.593674 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-afc04790-afdf-49af-b9ef-9e82187eef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:34.666643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1454/2913] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:34.678714 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:34.680603 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:34.765702 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2ccb-90a3-4fb9-9454-e49963651b05 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:34.772757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:34.773407 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:34.773708 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:34.773981 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:34.835364 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:34.837039 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:34.847013 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1460/2914] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:36.089684 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:36.090203 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:36.090270 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:36.109948 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] MFA Rules not processed for user `9f78486cf7a74b068d83bf755edee919`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:34:36.111301 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:36.118856 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1455/2915] 10.222.0.11 () {58 vars in 957 bytes} [Tue May 3 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:34:51.679350 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:51.681150 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:51.744085 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd802-fa78-4937-9bde-63212bb7d600 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:51.748429 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:51.749063 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:51.749338 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:51.749612 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:51.752245 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:51.763042 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:51.764566 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:51.773225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1461/2916] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:52.248700 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:52.250415 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:52.256529 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:52.265531 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96fb09-616c-4cb2-8eba-4ff48b110285 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:52.269799 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:52.270478 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:52.270757 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:52.271030 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:52.272971 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:52.286547 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:52.288031 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:52.299181 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1462/2917] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:52.321195 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370ae41-8aec-4ac2-92f6-f69557930a72 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:52.326453 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:52.327140 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:52.327419 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:52.327686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:52.329695 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:34:52.341720 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:52.343359 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:52.353643 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1456/2918] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:34:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:35:06.146888 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:35:06.148598 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:06.165417 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be901c5-13bb-42d1-8762-70d0fe7e76f1 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:35:06.171623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:35:06.172403 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:35:06.172673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:35:06.172956 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:35:06.174872 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:06.187634 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:35:06.189263 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:35:06.200277 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1463/2919] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:35:06.423165 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:35:06.433685 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679156b-db0f-4d50-9b2c-433db8520cbc service placement] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:35:06.438519 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:35:06.439167 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:35:06.439445 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:35:06.439713 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:35:06.441981 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:06.452673 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:35:06.454155 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:35:06.469112 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1457/2920] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:35:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:35:08.027356 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:35:08.037083 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537202-35b2-4537-9a0c-1a0adb4e2a61 service nova] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:35:08.041100 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:35:08.041740 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:35:08.042043 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:35:08.042315 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:35:08.054225 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:35:08.055659 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:35:08.065855 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1464/2921] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:35:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:35:10.028692 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:35:10.042887 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fa95-6aaa-4781-bd76-8dd8bde1c590 service neutron] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:35:10.049044 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:35:10.049702 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:35:10.049993 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:35:10.050271 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:35:10.052206 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:10.065005 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:35:10.066597 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f3519-4263-4eaf-902c-41eab981caf4 service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:35:10.078686 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1458/2922] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:35:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:37:15.431495 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:37:15.501903 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6604cc-4df1-45bc-a71f-598c6ccc97f9 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:37:15.512871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:37:15.513526 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:15.513802 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:15.514074 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:15.516370 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:37:15.552163 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:37:15.553788 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84735b-c357-41f7-b1c8-813e9ecfef02 service placement] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:37:15.565301 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1465/2923] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:37:19.064589 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7eb77-0e97-473e-8f3a-0fef69e1b7af None None] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.065136 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7eb77-0e97-473e-8f3a-0fef69e1b7af None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.067314 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7eb77-0e97-473e-8f3a-0fef69e1b7af None None] PATH_INFO: `/` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.068836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1459/2924] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 09:37:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:37:19.075395 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39936dd-5962-4f97-849b-05881570e164 None None] REQUEST_METHOD: `POST` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.076012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39936dd-5962-4f97-849b-05881570e164 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.076012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39936dd-5962-4f97-849b-05881570e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.117695 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.auth.core [None req-e39936dd-5962-4f97-849b-05881570e164 None None] MFA Rules not processed for user `91edd760fda54f15913465f5497ccfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:37:19.118973 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-e39936dd-5962-4f97-849b-05881570e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:37:19.126291 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1466/2925] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:37:19.138475 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7eb77-0e97-473e-8f3a-0fef69e1b7af None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:37:19.149922 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7eb77-0e97-473e-8f3a-0fef69e1b7af None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:37:19.153595 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:37:19.154256 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.154534 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.154838 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.163865 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:37:19.165282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7121b-2ca9-4a61-8c5e-7ed12c156446 service neutron] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:37:19.174723 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1460/2926] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:37:19.270380 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309f30-6fe5-4c1d-b691-ee8fac4cdac5 None None] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.270673 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309f30-6fe5-4c1d-b691-ee8fac4cdac5 None None] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.271012 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309f30-6fe5-4c1d-b691-ee8fac4cdac5 None None] PATH_INFO: `/` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.273017 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1467/2927] 10.222.0.11 () {54 vars in 921 bytes} [Tue May 3 09:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:37:19.278708 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] REQUEST_METHOD: `POST` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.278990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.279267 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.318739 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.auth.core [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] MFA Rules not processed for user `c491e8f0641945908a72a96a8e2927c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:37:19.320072 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:37:19.331266 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1461/2928] 10.222.0.11 () {58 vars in 1018 bytes} [Tue May 3 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:37:19.342249 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2309f30-6fe5-4c1d-b691-ee8fac4cdac5 None None] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:37:19.356901 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2309f30-6fe5-4c1d-b691-ee8fac4cdac5 None None] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:37:19.360796 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:37:19.361480 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:37:19.361760 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:37:19.362035 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:37:19.373108 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:37:19.374554 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:37:19.386394 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1468/2929] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:38:45.007520 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:45.026727 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cac1a-ed79-4347-93e6-f12c6d08b3d0 None None] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:45.034716 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c491e8f0641945908a72a96a8e2927c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:45.035380 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:45.036049 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:45.036332 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:45.038170 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:38:45.064584 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:45.065746 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:45.078898 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1462/2930] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:38:46.375254 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:46.384414 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5959-8a2c-423b-8c6e-7f5ba3072ac8 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:46.389060 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91edd760fda54f15913465f5497ccfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:46.389706 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:46.389990 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:46.390248 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:46.392466 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:38:46.407441 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:46.408954 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:46.420576 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1469/2931] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:38:55.523078 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:55.612651 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9f34-c3c3-41b1-a11f-dfcc4948f0ad service nova] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:55.619285 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:55.620641 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:55.621027 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:55.621424 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] PATH_INFO: `/v3/users/9f78486cf7a74b068d83bf755edee919` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:55.622973 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f78486cf7a74b068d83bf755edee919)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:55.625460 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:55.673073 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f78486cf7a74b068d83bf755edee919'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:55.673736 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f78486cf7a74b068d83bf755edee919'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:55.674374 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f78486cf7a74b068d83bf755edee919'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:55.685979 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f78486cf7a74b068d83bf755edee919'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:55.693868 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f78486cf7a74b068d83bf755edee919'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:55.707111 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1463/2932] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:38:55 2022] DELETE /identity/v3/users/9f78486cf7a74b068d83bf755edee919 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:38:55.889908 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:55.902791 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d73104-84d7-4882-bba8-8c2ec4ecf5e9 service neutron] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:55.969623 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:55.970561 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:55.970848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:55.971128 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] PATH_INFO: `/v3/projects/653db297f7174d809801b3687717832b` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:55.972460 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653db297f7174d809801b3687717832b)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:55.974423 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:56.020416 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653db297f7174d809801b3687717832b', 'request_id': 'req-fd21cd38-b600-46d2-afae-d2a730019ac1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.025848 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653db297f7174d809801b3687717832b', 'request_id': 'req-fd21cd38-b600-46d2-afae-d2a730019ac1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.032615 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653db297f7174d809801b3687717832b', 'request_id': 'req-fd21cd38-b600-46d2-afae-d2a730019ac1'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.058165 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] The token cache is being invalidate because project 653db297f7174d809801b3687717832b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:38:56.058455 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.059178 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.060909 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1470/2933] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:38:55 2022] DELETE /identity/v3/projects/653db297f7174d809801b3687717832b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:38:56.065405 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:56.067028 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:38:56.081361 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ccf31-538b-45df-a468-62baf507215a admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:56.139002 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:56.139967 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:56.140282 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:56.140564 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] PATH_INFO: `/v3/users/21e57dc843f34a60a726bbba60e56962` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:56.141897 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e57dc843f34a60a726bbba60e56962)` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:56.144816 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:56.193507 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e57dc843f34a60a726bbba60e56962'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.194160 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e57dc843f34a60a726bbba60e56962'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.194769 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e57dc843f34a60a726bbba60e56962'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.206990 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e57dc843f34a60a726bbba60e56962'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.215358 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.notifications [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e57dc843f34a60a726bbba60e56962'} {{(pid=86213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.229036 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1464/2934] 10.222.0.11 () {58 vars in 1223 bytes} [Tue May 3 09:38:56 2022] DELETE /identity/v3/users/21e57dc843f34a60a726bbba60e56962 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:38:56.402505 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Authenticating user token {{(pid=86214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:38:56.404058 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.fernet_utils [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:38:56.418511 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21cd38-b600-46d2-afae-d2a730019ac1 admin admin] Validating token access rules against request {{(pid=86214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:38:56.477095 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155689b863d044f782598840d769a7ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a709989f94ec462eae85b1893e89377a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:38:56.477974 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:38:56.478256 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:38:56.478528 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] PATH_INFO: `/v3/projects/3ea569abe3244544a7403a28e32ce103` {{(pid=86214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:38:56.479858 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea569abe3244544a7403a28e32ce103)` {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:38:56.481734 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] RBAC: Authorization granted {{(pid=86214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:38:56.529388 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea569abe3244544a7403a28e32ce103', 'request_id': 'req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.534542 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea569abe3244544a7403a28e32ce103', 'request_id': 'req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.542224 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea569abe3244544a7403a28e32ce103', 'request_id': 'req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6'} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.553581 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] The token cache is being invalidate because project 3ea569abe3244544a7403a28e32ce103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:38:56.553871 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.554527 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: DEBUG keystone.notifications [None req-bd61fa52-8b25-4ec0-8b05-5ff90da5d6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:38:56.556371 dv-cinder-840276-2-iscsi devstack@keystone.service[86214]: [pid: 86214|app: 0|req: 1471/2935] 10.222.0.11 () {58 vars in 1232 bytes} [Tue May 3 09:38:56 2022] DELETE /identity/v3/projects/3ea569abe3244544a7403a28e32ce103 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:42:21.443276 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Authenticating user token {{(pid=86213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:42:21.445883 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:42:21.525836 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3bea3-b7d0-41a7-bad1-2227c1040852 admin admin] Validating token access rules against request {{(pid=86213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:42:21.586773 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020655763b4c4606b1664ad43f047264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba5fb65c5b74666b911151d531b1a2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:42:21.587422 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] REQUEST_METHOD: `GET` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:42:21.587704 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] SCRIPT_NAME: `/identity` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:42:21.588011 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:42:21.589960 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.fernet_utils [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:42:21.601387 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:42:21.602983 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4cc3d-1299-4399-bebc-e50be78bfdf1 service placement] RBAC: Authorization granted {{(pid=86213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:42:21.612775 dv-cinder-840276-2-iscsi devstack@keystone.service[86213]: [pid: 86213|app: 0|req: 1465/2936] 10.222.0.11 () {60 vars in 1365 bytes} [Tue May 3 09:42:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)